Vedant Dixit

Developed ETL pipeline for loading data from souce DB to snowflake data warehouse. Build Data platform using AWS as Data lake and Snowflake as Data Warehouse. ETL workflow created using glue and scheduled them using workflow. Created view and stored procedure in snowflake from the staging/dimension as per requirment to load the data into dimension and fact table. Tech stack: pyspark, sql, snowflake and AWS services: s3 ,glue , cloudwatch, secret manager, workflow, triggers. Created an ml model using anaconda on the local machine. Migrated the model using sagmaker studio on sagemaker. Created a container to use different algorithms on models using an image. Deployed model on endpoints and used model monitor on top of it. Tech Stack: AWS ,pandas ,ml algorithms.

ETL env setup using databricks. Ml Model migration on aws sagemaker using sagemaker studio. Data Migration and data modeling for Godrej Housing Finance limited. Integration with S3 for source data and to store output data. Created a ETL flow using pyspark and sql on databricks. Tech stack : pyspark, sql, dbfs, databricks. Aws services : s3 ,Ec2 ,Iam role.