TMTATHAGATA MITRA
@tathagatamitra
Programmer Analyst
Kolkata, India
Tathagata Mitra is an experienced Programmer Analyst with expertise in data engineering and cloud technologies. He specializes in converting complex SQL logic into PySpark code and implementing robust data pipelines using Databricks and Snowflake. His professional background includes ingesting and transforming data from various sources like SQL Server and Teradata, while ensuring end-to-end data flow validation using AWS S3 and Tidal Automation.
Experience
Programmer Analyst (PA)
Cognizant Technology Solutions
Converting complex SQLs to PySpark code and implementing the same in Databricks notebooks. Analyzing SSIS Packages and implementing the analogous logic as PySpark code.
Programmer Analyst Trainee (PAT)
Cognizant Technology Solutions
Implemented pipelines to ingest data from multiple sources to target using PySpark code written in Databricks notebooks. Read the raw data from various sources (SQL Server, Teradata, flat files with extensions like csv) and ingested into Snowflake after cleansing and transforming the data while keeping it in Delta tables in S3 bucket (Intermediate layer). Performed the unit testing of the ingested data and validate the end-to-end flow of the process. Scheduling and monitoring of jobs to execute the Databricks notebooks through Tidal Automation.
Education
Smt. Kashibai Navale College of Engineering, Pune (SPPU)
Bachelor of Engineering
Electronics & Telecommunication Engineering
D.A.V. Public School, Patna
Intermediate
St. Karen's High School, Patna
Matriculation