Swaraj Danta
@swarajdanta
SOFTWARE DEVELOPER - BIG DATA
Bhubaneswar
Swaraj Danta is a proactive Software Engineer with 2 years of experience specializing in Big Data and ETL pipelines. He possesses strong analytical skills and expertise in developing end-to-end data solutions using technologies like Spark, Hadoop, AWS, Snowflake, and Teradata. He is skilled in optimizing complex data processes and ensuring data integrity across various platforms.
Experience
Specialist Programmer- Big Data
Infosys
Developing End to End ETL Pipelines with multiple combinations of sources and sinks like SnowFlake, Teradata, HDFS, Kafka and AWS S3 to handle structured and Semi-Structured Data. Optimized spark jobs in AWS and performed performance tuning of spark applications. Created automated scripts in python and wrote Teradata, snowflake queries for business users.
System Engineer-Big Data
Infosys
Monitored SLA Azure Data Factory pipelines and created/modified ETL Pyspark scripts through Azure DataBricks. Worked on CI/CD pipeline for deployment process and utilized JIRA, Confluence, and GIT in Agile methodology.
System Engineer- Big Data
Infosys
Managed migration of Teradata ETL scripts to Spark DataFrame and developed Kafka Producers and Consumers. Strong experience in real time data analysis using Spark streaming and Kafka. Optimized production jobs and performed error log analysis on Splunk, Autosys, and Spark UI. Developed POCs using Spark-SQL and analyzed data in Hive.
System Engineer-Trainee
Infosys
Proficient in SQL, Python, and Hadoop ecosystem, Hive, AWS, Spark and pyspark. Assisted with collecting, analyzing, and visualizing large datasets, demonstrating knowledge of data warehousing concepts and ETL processes.
Education
Silicon Institute of Technology
Computer Science Engineering