Default profile banner
KB

Kamal Bisht

@kamalbisht

SDE 2 - Data Engineer at Cars24

GURGAON

Cars24Institute of Management Studies & Engineering College

Software Engineer with 4+ years of experience building high-scale products in the fast-paced FinTech realm. Skilled in designing and implementing robust distributed systems, with deep expertise in cutting-edge Big Data technologies, Data Science, Machine Learning, Artificial Intelligence, and Generative AI. Passionate about driving innovation and efficiency through scalable, data-driven solutions.

Experience

SDE 2 - Data Engineer

Cars24

Invalid Date - PresentGurgaon

Designed and implemented an optimized MIS (Management Information System) pipeline, reducing the Month-End Close (MEC) process from 5 days to just 1 day. Automated workflows for multiple finance businesses, including CSPL, CFSPL, and NBFC, enhancing operational efficiency. Developed an ANPR (Automatic Number Plate Recognition) software for the company warehouse, significantly reducing costs through automation. Built a GenAI-powered MIS dashboarding solution, enabling end users to dynamically generate custom dashboards with AI-driven business insights and predictive trend analysis, enhancing strategic decision-making.

SDE 1 - Data Engineer

Sigmoid Analytics

Invalid Date - Invalid DateBengaluru

Worked on a project related to a Finance Model for Reckitt. Successfully managed and migrated 2 major and 1 minor project. Collaborated with the team to design pipeline architecture and data modelling. Developed and maintained comprehensive documentation for pipeline-related processes. Worked closely with clients and cross-functional teams, including Business Analysts (BA), Data Analysts (DA), and Data Scientists (DS). Managed, monitored, and upheld the operational integrity of data pipelines. Conducted rigorous data validation at Fusion and Power BI (PBI) layers to ensure data accuracy. Enhanced pipelines by incorporating new features such as key performance indicators (KPIs), Facts and Dimension Data. Implemented pipeline optimizations to enhance performance and efficiency. Proficiently utilized technologies including Azure Data Factory (ADF), Blob Storage, Azure Data Lake Storage (ADLS), databases (MSSQL), Databricks, PySpark, Data Warehousing (DWH), Azure Analysis Services (AAS), Power BI (PBI), Excel, and Fusion (SAP HANA).

SDE 1 - Data Engineer

Sigmoid Analytics

Invalid Date - Invalid DateBengaluru

Worked on a project related to a future Prediction model for Reckitt. Predicted current market prices and future prices of commodities, considering factors such as demand and supply. Extracted data from 3rd Party in CSV/JSON file format, API from the front-end team, and created a pipeline to extract the data from the WebSite. Stored the data in Azure Data Lake Storage (ADLS). Utilized Azure Data Factory (ADF) for data ingestion and DataBricks for the data Transformation into the desired format. Stored the transformed data into ADLS location for use by the Data Analytics and Data Science teams for prediction purposes. Technologies used: Azure Data Factory, Azure Data Lake Storage, Data Bricks, Blob Storage, Pyspark.

ASDE - Data Engineer

Sigmoid Analytics

Invalid Date - Invalid DateBengaluru

Involved in a Data Migration Project for Goldman Sachs. Focused on data ingestion, processing, transformation, and cleaning using Python. Wrote codes in Python and Scala to meet business requirements. Collaborated with clients to gather information and design logic. Refactored and migrated code, validated pipeline by running data on old and new pipeline. Conducted extensive investigation of critical data issues in the late stages. Experienced in working with Hadoop and its tech stack (MapReduce, HBase, Hive), Apache Spark, Python, Java, Scala, AWS, GitHub & GitLab, and CI/CD Pipeline.

Senior Software Engineer - Robotics Process Automations

HCL Technologies Pvt Ltd

Invalid Date - Invalid DateNoida

Collaborated with UiPath clients to design and implement an autonomous software pipeline for email notifications, leveraging the UiPath Framework to enhance automation efficiency and reliability.

Education

Institute of Management Studies & Engineering College

Computer Science and Engineering

Computer Science and Engineering

Invalid Date

Skills

Hadoop
MapReduce
Apache Spark
PySpark
Scala
C++
Kafka
ETL
ELT
Sqoop
Informatica
MSSQL
MySQL
NoSQL
Hive
HBase
Snowflake
Databricks
Microsoft Azure Cloud
Python
AWS
GCP
Data Structures and Algorithms
Problem Solving
Coding
DBMS
OS
Computer Networking
Data Science
Machine Learning
Artificial Intelligence
Gen-AI
PBI
Vector DB
Chroma
Azure Data Factory (ADF)
Blob Storage
Azure Data Lake Storage (ADLS)
Excel
Fusion (SAP HANA)
UiPath