Aman Singhal is a dedicated Cloud Data Engineer professional with experience designing, developing, and maintaining ETL pipelines using AWS Glue, Redshift, and Airflow. He has a strong background in utilizing cloud technologies like AWS to build scalable and fault-tolerant data solutions. His expertise includes optimizing data pipelines and implementing CI/CD processes.
Experience
Cloud Developer
Verisk
Designed, developed, and maintained ETL pipelines to integrate data from various sources into a data warehouse using AWS Glue, Redshift, S3, GitLab, Docker, Airflow, EC2, AWS lambda, Boto3, and spark with python. Communicated with business departments to understand needs and requests in order to build 25+ data pipelines. Monitored and optimized the performance of existing data pipelines to ensure data quality and integrity. Utilized cloud technologies like AWS to design and deploy scalable and fault-tolerant data pipelines. Created and maintained continuous integration and deployment processes using AWS services, GitLab-CI, and Docker. Employed performance tuning strategies that reduced CPU utilization of execution of ETL Pipeline by 40% to 50%. Implemented Scripts to Automate Manual Tasks. Built a web app to upload the data to DataLake which reduced the time taken by manual steps from minutes/hours to seconds.
Education
APJ Abdul Kalam Technical University
BTech - Bachelor of Technology
Computer Science
Licenses & Certifications
AWS Certified Solutions Architect Associate
Amazon Web Services (AWS)
AWS Certified Cloud Practitioner
Amazon Web Services (AWS)
Microsoft Certified: Azure AI Fundamentals
Microsoft