SCSouvik Chattopadhyay
@souvikchattopadhyay
Data Engineer
Durgapur, India
Souvik Chattopadhyay is a Data Engineer with over 6 years of experience in handling vast datasets. He specializes in developing and testing end-to-end data pipelines across both cloud and on-premise systems. His expertise includes utilizing technologies like PySpark, Python, and various AWS components for data transformation and orchestration.
Experience
Senior Software Engineer
Marlabs
Worked as part of Agile team, responsible for the delivery of Data Lake in AWS. Development and testing of end to end data pipeline from different source systems to final layer of data lake in AWS S3, applying transformations and orchestration using Spark , Python , S3 and other AWS components.
Associate Consultant
MSH Business Consulting
Part of Agile team, responsible for ETL development and testing. Development and testing of data pipelines from on-premise SQL and noSQL sources to DW, using PySpark, and BI reports using Tableau / Python.
Associate
Cognizant
Part of development teams, responsible for data validation and automation for ETL and DW implementation projects using Informatica , Python.
System Engineer
Tata Consultancy Services
Part of development teams, responsible for development, data validation and automation for ETL and BI projects using Informatica, Tableau.
Education
Dr. B C Roy Engineering College
B.Tech