Ramit Agarwal

Worked on LUMI, the NGBD platform for Amex, focusing on moving data securely from OnPrem to GCP or vice versa. Responsibilities included participating in user story and design discussions and developing the framework for encrypting/decrypting data.

Created an internal data lake for employee and organizational resume details. Responsibilities included designing solutions to consume data from APIs and designing/writing parsing logic for resumes using Spark/SparkSQL.

Built an online bookstore portal for ordering/returning rental books, including building a recommendation algorithm.

Developed a platform to collect and process data from set-top boxes for viewership calculation. Responsibilities included data cleaning, transformation, adding Data Quality checks (DQ), and optimizing Spark parameters.

Developed a vehicle and driver tracking platform. Responsibilities included creating web services fetching data from Mongo DB/HBase, creating multiple alert pipelines, and generating scheduling reports.

Supported the migration of data from Teradata to Palantir Foundry for United Airlines. Responsibilities included creating pipelines on Foundry for ingesting high load data feed files and performing transformations using Spark/SparkSQL, and designing multiple modules for real-time datasets.

Developed Cloak, a secure Data Lake implementation on MapR file system for Amex registered card data. Responsibilities included participating in user story/design discussions and working on the Web service and migration modules.

Worked on a POC using map-reduce to fetch data from IMDB dataset and perform operations using Hive and Pig queries.

Worked on mining vast amounts of customer data for efficient reporting solutions. Responsibilities included analyzing problem statements, participating in design discussions, and developing solutions.