Sharath Manchala

Prepared technical documentations HLD and LLD for New Payment Architecture (Faster Payments). Design, create, implement and Managing end-to-end development process of NPA Project. Working collaboratively with Product managers, developers and end-users to deliver working solutions.

Worked on the DCR enhancements like Data As a Service and Application Platform as a Service. Worked on Grafana Dashboard for DAGS/Tasks Health and Kubernetes Metrics. Implementation of Data Quality Checks Framework in Spark/Scala and optimized from 1hour to 25mins. Automated the DQA using Airflow. Automated terabytes of Data Ingestion process using Rest API's from AWS S3 to MDL (Media data lake) using Airflow which saved 50k USD s3 storage cost per year. Migrated all the DCR Code repositories from Bit Bucket to one Nielsen Media GitLab account.

Digital Content Ratings - Spark Rewrite. Designing, creating, testing and maintaining the complete data management & processing systems in AWS Cloud using EMR , Spark-Scala and Airflow. Created data models to reduce system complexities and hence increase efficiency & reduce cost. Worked closely with the stakeholders & solution architect to gather the requirements and implement them. Worked on Airflow as a Platform to Programmatically author, Schedule and monitor the Jobs.

Designing, creating, testing and maintaining the complete data management & processing systems in AWS Cloud with Spark-Scala. Created data models to reduce system complexities and hence increase efficiency & reduce cost. Developed a POC in Apache Kafka and Amazon Kinesis for DQA Process. Worked on Data Quality Check Queries in Hive and Impala. Worked closely with the Nielsen Catalina solutions to gather the requirements. Scheduled and Automated the Jobs using TIBCO and Apache Airflow.

Research, Data Analysis & Interpretation, preparing reports. Worked closely with sales team to understand their research projects. Tracking the market trends there by generating & analysing reports.