Data engineer with 3 years of experience specializing in designing and implementing efficient data pipelines using Azure cloud services. Expertise in driving robust analytics and delivering valuable business insights to support informed decision-making. Proven ability to leverage cloud technologies for scalable data solutions.
Experience
Data Engineer (Business Technology Solutions Associate)
ZS Associates
Automated conversion of 1500+ Parquet tables to Delta, reducing manual effort by 80%. Developed rollback scripts ensuring 100% recovery. Handled edge cases like empty tables and schema mismatches, ensuring 99.5% success rate. Optimized 10+ Delta pipelines, improving data processing efficiency by 40%. Developed and automated the creation and distribution process of target lists for Non-Personal Promotions across 6 healthcare brands, eliminating manual intervention and reducing processing time by 75% per brand. Played a critical role in testing during project re-architecture, automating testing processes. Addressed client needs through multiple change requests, resolving discrepancies in downstream extracts. Expertise includes developing Python scripts to transfer files from Azure Blob Storage to AWS S3.
Education
Shiv Nadar University
Bachelor of Technology
Compute Science Engineering
Awarded ZS Project Impact Award (2x), ZS Collaboration Award, and ZS Growth Award.
Licenses & Certifications
Microsoft Certified: Azure Fundamentals (AZ-900)
Microsoft
Microsoft Certified: Azure Data Fundamentals (DP-900)
Microsoft
Databricks Certified Associate Developer for Apache Spark 3.0 - Python
Databricks