Avinash Baratam

Trade Data Analytics team is responsible for delivering the Bigdata Solutions across the Bank. Built Customer 360 view with Lambda Data Architecture with Realtime and Batch data flowing leveraging Spark, Spring Boot Api, Oracle, Dataiku and Hadoop. Built an end-to-end pySpark pipeline on Dataiku with Spark & Hadoop along with the Dremio. Consists of a spark scala pipeline built with MLOps, feature engineering is done on Spark Scala.

Centralised Data Lake built on Hadoop & Spark with an idea to have all the Bank's Tp Systems data available at one place. Developed Spark pipelines which takes the data from hive and generate the reporting outputs for various visualisation tools. Worked on the full lifecycle solution for building pipeline framework for loading the raw data files into Hive through MR, Hive, Falcon and Oozie. with various levels of validations. Configure and calibrate tuning parameters for the application performance.

This project abundantly delivers Big data related project solutions across Airlines and Hospitality Domain Space. Worked on full lifecycle for the Big Data Solution to requirement Analysis, technical Architecture design and development. Implemented Real time PNR data pipeline through Kafka, Spark and Hbase.