Adarsh Talniya

Worked on development and enhancement of Batch Ingestion Framework for Lloyd’s Bank using Spark, Scala and Hive to ensure that data gets ingested from source to hive tables with just few changes in param properties. Worked on integration of ingestion framework with assurance framework using Spark, Scala and Hive to validate ingested data according to bank standards and populate reconciliation entries into a lab wide central recon table. Worked on enhancement and testing of Ingestion Framework that pulls nested JSON files using an API call and flattens them into multiple hive tables. Worked on development of Curation Framework that takes multiple hive tables from user, performs various operations like join, column rename, column deletion, data type conversions and many more, and finally writes the resultant table to given hive location with just few changes in param properties. Currently working with adoption of Google Cloud Technologies to cater future requirements for migration of above frameworks to GCP.