Sumit Chaurasia

Currently leading data integration track in Digital Transformation project to design data models, develop automated data pipelines and build a scalable data warehouse, driving data-driven decisions. Improved automated data integration batch processing speed in AWS Glue by 40% using Spark for distributed data processing and PySpark for efficient data transformations in an existing planning project. Completed hands-on, in-person training on the APS Data and Integration stack, mastering Spark, PySpark, SparkSQL and Apache Airflow, enabling migration from on-premise to modernized data integration processes.

Led database design and development along with automated ETL project in RDBMS, reducing SQL Server batch processing time by 90% through T-SQL query optimization and performance tuning. Developed robust data models using fact and dimensional modeling techniques, including star and snowflake schema, to enhance data warehouse solutions and facilitate efficient data migration. Designed architecture of ETL & ELT pipelines using SQL Server Integration Services, Azure Data Factory, Databricks and Spark, integrating various sources for digital supply chain transformation projects.

Developed data integration solutions to enable seamless data flow through integrated supply chain processes. Collaborated with Technical architect to translate business requirements into technical specifications. Developed & optimized T-SQL stored procedures for data validation, significantly reducing data inconsistencies by 40% and improving the accuracy of supply chain solver output.