Harshit Jain

Utilized Azure DataBricks to import and transform data from DevOps, employing various techniques to clean, filter, and restructure data large volumes of data. Created ETL using Azure Data Factory, ADLS and processing in Databricks (using Spark and Python). Developed Optimized Power BI reports on large-scale and worked on ETL cycle and SQL queries. Conducted thorough peer reviews, guaranteeing elite quality in code, architecture, and security. Developed, engineered, and oversaw ETL pipelines, streamlining data integration and data ingestion from diverse sources. Transformed raw data into 100+ impactful visualizations, including crucial KPIs, and trends, driving informed decision-making. Efficiently coordinated the handling and on-time deployment of multiple projects, ensuring their successful execution within the designated timelines. Used Git for version control and collaborate with DevOps teams to integrate data engineering processes into CI/CD pipelines. Designed and maintained scalable data pipelines using Microsoft Fabric’s Data Factory, Lakehouse, and Dataflows Gen2, integrating structured and unstructured data from multiple sources into OneLake for unified analytics and stora