Aman Agrawal

Received Applause and Spot Award for top impactor. Client Infrastructure Modernization to AWS. Provisioning all AWS resources using Cloudformation templates using Bitbucket and Bamboo data pipeline. Converting Cobol DB2 batch scripts business logics into data transformation rules in Pyspark running on AWS Glue ETL. Created one time data migration and validation scripts in Pyspark to migrate DB2 legacy tables to AWS Aurora Cluster. Orchestration of Glue Jobs using AWS Glue workflow, Triggers, AWS Step functions, Control-M etc. Configure FTP on EC2 instances. Load real-time streams into Aurora using AWS Kinesis and Kafka. Creation of JDBC connections and Glue network connector through cloudformation template that assists with accessing data stores in AWS Glue Studio and other AWS services. Develop and maintain data pipelines to extract data from a variety of sources(DB2, Kafka etc.) and populate target database. Implementing data quality checks and perform unit test of pyspark scripts using python libraries like boto3, moto, mock, awsglue utils etc running over a docker container in python venv and generating sonar coverage report.

Create a dynamic shopping cart template with HTML/CSS/TypeScript/Angular. Create API's for shopping cart application with Spring Boot MVC and enter table records in postgresql database running on docker container. Used pyspark script to fetch real-time stock index data from kafka server/broker and create a data pipeline to ETL into postgresql database.