DADIVYA ANAND
@divyaanand
Data Engineer at Futurense Technologies
Bangalore, India
Highly skilled Data Engineer with experience in building and maintaining robust data pipelines using big data technologies. Proficient in optimizing Spark jobs and automating data loading processes using Airflow and shell scripting. Experienced in data cleansing, ETL processes (Mysql to Hadoop/Hive), and developing long-term data platform architectures.
Experience
Data Engineer
Futurense Technologies
Creating and maintaining data pipelines built using big data technologies. Automating data injection and loading process using shell script and scheduling it using airflow. Responsible for optimising the spark jobs and making it time efficient with improved performance.
Project Engineer
Wipro
Responsible for Analysis, understanding requirement, Implementation and checking functionality of project. Creating a data pipeline from Mysql to Hadoop or Hive vise versa using Sqoop. Cleansing of data using Pyspark. Works closely with all business units and engineering teams to develop strategy for long term data platform architecture. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Education
Heritage Institute of University
B.Tech
Information Technology
D.A.V B.S.E.B Colony
Secondary Education Class XII
D.A.V Gola Road
Primary Education Class X
Licenses & Certifications
Certified in Big Data
Coursera & NPTEL