Aakash Singla

Automated data validation processes for data pipelines handling 5000 events per second, ensuring accuracy and integrity of data. Developed and implemented validation frameworks using PySpark, Python, and SQL to validate 2 years of backfill data and streaming data, totaling 500 GB per day for the Silver layer (OneApp). Conducted comprehensive pipeline testing, ensuring efficient data flow and adherence to transformation logic requirements for both the Silver layer (OneApp) and YoungApp. Collaborated with the Data Engineering team to identify and resolve data quality issues, improving overall data reliability and system performance. Utilized Nifi, AWS Athena, Redshift, EMR, and Glue to optimize data validation processes and enhance scalability for both the Silver layer (OneApp) and YoungApp. Worked closely with stakeholders to define data quality metrics and establish data quality standards for both platforms. Created and maintained detailed documentation for data validation procedures and test cases, facilitating knowledge transfer and onboarding of new team members.

Handling multiple clients from various industries and delivering applications that meet their requirements. Assisting in the development of in-house products. Developing end-to-end solutions using Azure Cognitive APIs such as Form Recogniser, Custom Vision, LUIS, etc. Creating 5 Proof of Concepts (POCs) for different Industries and leading 2 of them as the lead developer. Being part of a team of 2 that trained 40 new interns.