Amartay Shrivastava
@amartayshrivastava
Data Engineer at Tata consultancy services
Noida, India
Amartay Shrivastava is an experienced Data Engineer skilled in developing and maintaining scalable data pipelines using Apache Spark, Databricks, and Python. He has implemented robust ETL processes across on-premises and cloud environments, significantly improving data processing efficiency. Proficient in cloud computing (Azure, AWS) and data warehousing solutions using Delta Lake, he also utilizes Power BI and Tableau for advanced data visualization.
Experience
Data Engineer
Tata consultancy services
Developed and maintained scalable data pipelines utilizing Apache Spark, Databricks, and Python. Implemented ETL processes on-premises (SSIS) and cloud (Azure Data Factory, Snaplogic) to extract, transform, and load data, resulting in a 30% reduction in data processing time. Designed and implemented a robust data warehousing solution using delta lake concepts, improving reporting efficiency by 50%. Orchestrated data workflows using Apache Airflow, resulting in a 25% improvement in overall data processing efficiency. Proficient in cloud platforms like Microsoft Azure and Amazon Web Services (AWS), and successfully managed big data in petabytes and exabytes using technologies like HDFS and Apache Spark.
Education
G.L Bajaj institute of technology and management
B.Tech
Computer Science
Top 5 Percent Batch of 2021
St. Lawrence School Unnao, India
Intermediate
St. Lawrence School Unnao, India
High School