Chetan Sakarde

Worked on ETL pipelines using airflow, glue, airbyte, athena, redshift, step functions, cloudformation, event bridge and lambda for fetching data from mongo, sending email alerts, sending data to various portals and orchestration. Worked on the migration activity of all the pipelines of NiyoX product to aws infra using glue, step functions, lambda, cloudformation, event rules, cloudwatch and other aws services. Worked on the migration activity of airflow docker dags pipelines to AWS MWAA. Migrated ETL pipeline to query the data from redshift and athena and sending the output over the mail using lambda, SES, SNS, redshift, athena, cloudwatch and other aws services. Built Quicksight and Metabase dashboards for the product team to better analyze data and take important business decisions. Majorly worked in python for writing airflow dags, scripts for fetching data, sending emails, alerts, transformation of data and pushing data. Majorly worked on data lake creating glue scripts to migrate collections from source mongoDB to athena using pyspark and glue dataframe. Worked on ad-hoc requests to query the data and create MIS using Postgres SQL.