Default profile banner
AD

Aman Dutta

@amandutta

Data Engineer at Jio

Kalash Udyan, Vashi, Navi Mumbai

JioNational Institute of Technology, Jaipur

Aman Dutta is an experienced Data Engineer with expertise in building and optimizing high-volume data pipelines. At Jio, he successfully optimized Apache Spark-Scala jobs, achieving a 40% improvement in execution time. His skills include utilizing Apache Kafka, Java, and Spark for data ingestion, transformation, and ensuring proper storage in SQL and NoSQL databases.

Experience

Data Engineer

Jio

Full-time•Jul 2021 - Present•Navi Mumbai, Maharashtra

Optimized an Apache spark-scala job which resulted in 40% improvement in Job execution time. Responsible for finding and fixing bugs in legacy codes. Maintained, scaled, and improved a data pipeline to ingest and transform data from sources into a centralized data warehouse using Apache Kafka, Java, and Apache Spark. Ensured proper storing of raw and processed data in SQL and NoSQL databases, and was involved in Data modeling. Developed and maintained Python scripts to automate project deployment. Worked with Engineering teams to ensure continuous development and bug fixes of a Dashboard according to requirements from Product Managers, Business stakeholders, and Testers. Mentored, provided code review, and technical guidance to GETs, and conducted technical interviews for data engineering candidates.

Education

National Institute of Technology, Jaipur

Bachelor of Technology

Computer Science and Engineering

Aug 2017 - May 2021

Skills

Python
Scala
SQL
Java
Apache Spark
Apache Kafka
Hadoop
Linux
Apache Cassandra
MongoDB
Apache Airflow
Crontab
AWS
AWS Glue
Athena
S3
Data Modeling
ETL