DHRUVIL SHAH

Part of the Enterprise Data Solutions Team, working for a well-known American banking client: Citizens Bank, where I play a pivotal role in supporting the Datalake as well as various ETL applications delivering high-quality solutions tailored to the specific requirements for the enterprise. Designed, developed, and maintained ETL processes for extracting data from various sources, like Databases, Fixed Width/Delimited Files, Mainframe Files, APIs, etc. transforming it, and loading it into the Data Lake and Data Marts. Worked on several enhancements and job optimizations addressing bottlenecks and achieving significant improvement in job performance. Identified and rectified data quality defects, ensuring accuracy, consistency, and integrity across datasets. Migrated several Data ingestion batches from Talend to Pyspark achieving atleast a 50% reduction in execution time. Tuned SQL queries to handle larger datasets, with millions of records, efficiently using resources and reducing overall load on the infrastructure. Resolved complex and critical production issues, performed root cause analysis, proactively identified system inefficiencies, and applied creative solutions and bug fixes to ensure system stability and data accuracy. Implemented an automation script to add partitions to tables instead of using crawlers, reducing service costs by over 90% and significantly speeding up partitioning processes. Conducted thorough code reviews and facilitated handovers from other teams, ensuring adherence to best practices and maintaining high code quality. Mentored several team members in ETL best practices and advanced use of AWS services, creating documentations as well as training materials.