AYAtul Yadav is a Data/DevOps Engineer seeking an entry-level role focused on ETL processing. He is skilled in automating data transformations and improving data quality using tools like Python, Apache Airflow, and AWS services. He is committed to leveraging his technical knowledge to contribute to organizational success.
Experience
Data Engineer Intern
Gumanco Software solution
Developed and deployed an ETL pipeline using Apache Airflow, facilitating the seamless integration of large-scale data into the service. Leveraged Terraform to create and manage AWS infrastructure and worked on various AWS services. Conducted data conversions at scale, ensuring accurate and timely integration into the service. Utilized Scrapy to crawl and extract raw data from various websites, processing and analyzing it for further use in the service. Created and maintained data pipelines for efficient and reliable extraction, transformation, and loading of data from various sources into the service. Managed and monitored the ETL pipeline, troubleshooting any issues that arose and ensuring the pipeline operated smoothly and efficiently.
Education
Govt Industrial Training Institute
ITI (COPA)
Swami Vivekanand College of Engineering
B-tech
Licenses & Certifications
Astronomer certification for apache airflow Fundamentals