Default profile banner
DP

Diwakar Paliwal

@dp04

Assistant Manager – Data Engineering & Analytics at Genpact

India

GenpactSt. Peter's College, Agra

Results-driven Data Engineer with 4+ years of experience in building scalable data pipelines, ETL automation, and cloud-based analytics solutions. Proven expertise in Python (pandas, PySpark), SQL, Snowflake, and Databricks with hands-on experience in data ingestion, transformation workflows, and reconciliation processes. Skilled in translating business requirements into production-grade data solutions and collaborating with cross-functional teams to support data-driven decision-making.

Experience

Assistant Manager – Data Engineering & Analytics

Genpact

Jan 2023 - PresentNoida, Uttar Pradesh

Built and maintained scalable ETL pipelines using Snowflake and Databricks with PySpark for distributed processing of 25+ financial datasets, ensuring 100% data accuracy across reconciliation workflows; Developed automated reconciliation reports using Python (pandas) and SQL, onboarding them to internal automation tool (Finance Platform) and reducing manual reporting time by 90%; Led end-to-end migration of legacy reporting systems to modern cloud-based workflows, restating 10+ years of historical data using SQL-based transformation logic and validation frameworks; Developed Python scripts to integrate with REST APIs for automated data ingestion, enabling seamless data extraction from external sources into data pipelines; Took ownership of 150+ monthly BAU processes during team attrition, training new resources on Python, SQL, and platform workflows while ensuring SLA compliance and timely delivery

Programmer Analyst – Data Engineering

Cognizant

Jan 2021 - Jan 2023

Managed SQL databases and optimized data retrieval using advanced stored procedures, improving query performance by over 60% and streamlining daily operations; Implemented trigger-based data validations to ensure data integrity, proactively detecting anomalies and protecting downstream analytics workflows; Developed comprehensive documentation of data processes and workflows, receiving multiple client appreciations and internal awards for delivering high-quality solutions

Education

Jaypee University of Information Technology

Bachelor of Technology (B.Tech)

Biotechnology

Jan 2017 - Jan 2021Grade: 9.8/10

Awarded Gold Medal and conferred Honors Degree for academic excellence, graduating with CGPA of 9.8 in B.Tech Biotechnology

St. Peter's College, Agra

Senior Secondary (Class XII)

Science Stream

Grade: 85.4% (ICSE)

Licenses & Certifications

Microsoft Certified: Azure Fundamentals

Microsoft

Issued: Oct 2022• No expiration

Skills

Python
pandas
PySpark
SQL
Advanced Excel
Snowflake
Databricks
Azure
ETL Pipelines
Data Modeling
Data Ingestion
Data Reconciliation
SQL Databases
Stored Procedures
Triggers
Query Optimization
Data Analytics
Business Intelligence
Process Automation
Team Management
Stakeholder Management
Agile Delivery