Default profile banner
AY

Akash Yadav

@akashy

Data Engineer at GIGMO SOLUTIONS PVT. LTD.

Gurugram, Haryana

linkedin.com/akash-yadav-b29915230

GIGMO SOLUTIONS PVT. LTD.AMITY UNIVERSITY HARYANA

Akash Yadav is a dedicated developer with strong analytical and problem-solving skills, proficient in Azure, Python, PySpark, and SQL. He has experience processing large amounts of data and is adept at quickly learning new technologies to increase efficiency. He thrives in Agile environments, contributing to team success through activities like test coordination and peer reviews.

Experience

Data Engineer

GIGMO SOLUTIONS PVT. LTD.

Mar 2023 - Present

Developed and optimized web scraping scripts using Python and libraries like Beautiful Soup, Scrapy, and Selenium, successfully extracting data from over 50 websites with a 99% accuracy rate, while managing workflows with Apache Airflow. Collaborated with cross-functional teams on 20+ projects, maintaining code quality and integrating data storage solutions such as SQL/NoSQL databases, leading to a 30% improvement in data processing efficiency and a 25% reduction in data storage costs.

Azure Data Engineer

CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED

Mar 2022 - Jan 2023

Designed, developed, remodeled and upgraded CI/CD pipelines in Microsoft Azure processing over 10000 GB data and a success rate of 100% with 0 PGLS issues. Collaborated with senior developers to make technology upgrades. Tested and debugged changes to application subsystems. Performed quality assurance to ensure applications deliverables met customer standards. Peer reviewed 100+ objects helping ensure dev standards across the project. Worked very closely with Infrastructure and Quality Assurance team, business end-users and SME’s on a daily basis with continuous test-driven approaches as it relates to code development, unit testing and production release.

Data Engineer

LOWES

Jan 2022 - Mar 2022

Upgraded CI/CD pipelines as assigned by management and collaborated with business support professionals to ensure applications deliverables met customer standards. Improved the experience of data users by soliciting feedback and making mapping improvements on 50+ object pipelines. Supported code deployments across different types of source data including csv, parquet, SAP Hana, SQL and delivered pipeline deployment through the whole system lifecycle.

Data Analyst

MILLENNIAL GARAGE

Jun 2021 - Jan 2021

Oversaw data collection and consolidation for reporting and designed and built dashboards used to monitor performance metrics. Utilized advanced analysis actions, calculations, parameters, background images, maps, trend lines, groups, hierarchies, detail level summary report sets, and KPI dashboards. Communicated effectively across multiple platforms and departments by performing various QA tasks and evaluating workflow. Aligned with Agile Methodologies, scrum stories, and sprints in a Python-based environment in association with data analytics and Excel data extracts.

Education

AMITY UNIVERSITY HARYANA

B.Tech

Jan 2017 - Jan 2021

Collaborated on a Research paper for designing and implementing a Flutter application inculcating Computer Vision techniques through tflite packages with SSD MobileNet accuracy of upto 89.9% and MobileNet accuracy of 64.3%. Awarded as Outstanding Delegate while representing Japan at ASET MUN 2019. Secured 2nd position in Inter University Basketball Competition at Sangathan 2019. Administered ‘Soch Vichar 2.0’, an initiative of CRC, Amity University Haryana.

Licenses & Certifications

Agile Software Development

University of Minnesota

• No expiration

Retrieving, Processing, and Visualizing Data with Python

University of Michigan

• No expiration

Intermediate Relational Database and SQL

Coursera

• No expiration

Skills

Python
SQL
Azure Data Factory
Azure DevOps
Azure Databricks
PySpark
PowerBI
MS Excel
Agile
Scrum
Beautiful Soup
Scrapy
Selenium
Apache Airflow
NoSQL databases
CI/CD pipelines
Parquet
SAP Hana