B M VINJIT

Developed a comprehensive pipeline for RichMedia Publisher utilizing HUDI and DMS, incorporating robust logging, alert notifications, profiling, and monitoring utilities. Implemented logical replication of PostgreSQL DB through the creation of both streaming and non-streaming Change-Data-Capture (CDC) mechanisms using various output plugins. Engineered an application capable of concurrently crawling videos across multiple OTT platforms and capturing screenshots for subsequent image processing.

Provided data engineering dashboard functionality to Import & Export Mappings. Built backend capability for pushing heavy and long-running tasks to the Background to prevent the server from blocking other smaller tasks. Created an Auto-Discovery feature for the dashboard to discover relationships and constraints in the data. Created a generic functionality for the backend of the data engineering dashboard to support both Oracle and Postgres. Developed APIs for connectivity to Kafka, Teradata, Hive & Scylla. Automation and report generation of complex activities. Involvement in activities and providing end-to-end support in 4 productions (LTE, DSL, fallout, and historic account migration). Created mappings on Informatica for data migration processes. Single-handedly managed a team of 4 interns and built the Smart Assurance utility tool End-to-End.

Understood concepts of data migration in the Telecom domain. Involvement in various day-to-day execution, monitoring, and debugging activities. Built a generic feature to send the reports, results, and logs on mail from the server.

Whatsapp Web Crawler, VxVault Crawler, Malicious Files Data Indexing, Automatic Whatsapp Message Sending Application, Phishing Website Crawler.