Diwakar Paliwal
@dp04
Assistant Manager – Data Engineering & Analytics at Genpact
India
Results-driven Data Engineer with 4+ years of experience in building scalable data pipelines, ETL automation, and cloud-based analytics solutions. Proven expertise in Python (pandas, PySpark), SQL, Snowflake, and Databricks with hands-on experience in data ingestion, transformation workflows, and reconciliation processes. Skilled in translating business requirements into production-grade data solutions and collaborating with cross-functional teams to support data-driven decision-making.
Experience
Assistant Manager – Data Engineering & Analytics
Genpact
Built and maintained scalable ETL pipelines using Snowflake and Databricks with PySpark for distributed processing of 25+ financial datasets, ensuring 100% data accuracy across reconciliation workflows; Developed automated reconciliation reports using Python (pandas) and SQL, onboarding them to internal automation tool (Finance Platform) and reducing manual reporting time by 90%; Led end-to-end migration of legacy reporting systems to modern cloud-based workflows, restating 10+ years of historical data using SQL-based transformation logic and validation frameworks; Developed Python scripts to integrate with REST APIs for automated data ingestion, enabling seamless data extraction from external sources into data pipelines; Took ownership of 150+ monthly BAU processes during team attrition, training new resources on Python, SQL, and platform workflows while ensuring SLA compliance and timely delivery
Programmer Analyst – Data Engineering
Cognizant
Managed SQL databases and optimized data retrieval using advanced stored procedures, improving query performance by over 60% and streamlining daily operations; Implemented trigger-based data validations to ensure data integrity, proactively detecting anomalies and protecting downstream analytics workflows; Developed comprehensive documentation of data processes and workflows, receiving multiple client appreciations and internal awards for delivering high-quality solutions
Education
Jaypee University of Information Technology
Bachelor of Technology (B.Tech)
Biotechnology
Awarded Gold Medal and conferred Honors Degree for academic excellence, graduating with CGPA of 9.8 in B.Tech Biotechnology
St. Peter's College, Agra
Senior Secondary (Class XII)
Science Stream
Licenses & Certifications
Microsoft Certified: Azure Fundamentals
Microsoft