Aditya Gupta

Following Agile Methodology and working as a key developer of an application which is responsible in processing data from Databricks to ServiceMax (Downstream Application) via Talend Jobs. Experience in migration of Application from GPDB to Databricks on AWS that includes migration of Talend Jobs to Databricks Workflows, and code conversion from SQL to PySpark and Spark SQL considering PySpark optimizations Techniques. Worked on GPDB using SQL for new enhancements, defects. Ensure code optimization that results in increased performance by 30%.

Helped in decision making of cost-efficient architecture between ECS and Lambda after considering business usage and concurrency. Worked on WebSocket API connection that submits the request to Redshift via Redshift Data API using Lambda. Configured DynamoDB to store the connection info and S3 to store the SQL scripts. Configured Redshift Data API with Eventbridge to notify about query completion and to trigger Lambda to push the results back to end user and delete connection info from DynamoDB.