Default profile banner
DS

Divya Sharma

@div_bird

Data Engineer at Innocrazy Tech Services Private Limited

Ghaziabad, Uttar Pradesh, India

Innocrazy Tech Services Private LimitedSymbiosis Centre for Distance Learning

Data Engineer with 4+ years of experience in designing and building scalable data pipelines and ETL workflows using Azure Data Factory, Azure Databricks, PySpark, and SQL. Experienced in processing large datasets, optimizing data pipelines, and delivering analytics-ready datasets for reporting and business insights. Skilled in data transformation, performance optimization, and supporting Power BI dashboards to enable data-driven decision making. Possess 10+ years of overall professional experience in data analysis, reporting, and business intelligence.

Experience

Data Engineer

Innocrazy Tech Services Private Limited

•Sep 2024 - Present

Designed scalable ETL pipelines using Azure Data Factory for ingesting data from multiple sources. Developed PySpark transformations in Azure Databricks for large-scale data processing. Built and maintained data ingestion pipelines ensuring reliable workflows. Optimized data pipeline performance and improved processing efficiency. Delivered analytics-ready datasets for Power BI dashboards and reporting.

Data Analyst

Hinduja Global Solutions Ltd

•Dec 2023 - Aug 2024

Developed scalable ETL pipelines in ADF and Databricks handling high-volume sales and transaction data. Used PySpark for data transformation, deduplication, and aggregations. Optimized pipeline performance reducing processing time by 25%. Created robust SQL queries to support reporting and analytics teams.

Data Analyst

Arbre Creations

•Jul 2021 - Nov 2023

Designed reusable ADF pipelines to automate ingestion, cleansing, and transformation of structured data. Built PySpark scripts for large-scale data joins and cleansing. Implemented staging and production layers with version control and rollback safety. Improved job runtime and resource utilization using Databricks optimization techniques.

Customer Service Associate (MIS Reporting)

Tech Mahindra

•Sep 2020 - May 2021

Analyzed Excel datasets to generate operational insights. Created MIS reports and dashboards for internal stakeholders. Automated daily and weekly performance reports using Excel.

MIS Executive

Atomants E-Services

•Jul 2015 - Aug 2020

Collected and processed sales data for reporting and analysis. Performed sales analysis to generate business insights. Prepared sales reports and dashboards for internal stakeholders.

Education

Symbiosis Centre for Distance Learning

PG Diploma

Data Science

Jan 2006 - Jan 2010

Vinayaka Mission University

B.Com

Jan 2002 - Jan 2005

Skills

Python
SQL
PySpark
Power BI
Excel
Power Query
Azure Data Factory
Azure Databricks
ETL/ELT pipelines
Matplotlib
Seaborn
GitHub