Varun Kapoor
@Varunkp98
Data Engineer at Bank of America
Delhi, India
Data Engineer with 3 years of experience specializing in ETL processes, data pipeline design, and cloud technologies. Proficient in SQL, Python, and AWS services. Experienced in migrating legacy systems to modern frameworks like Apache Spark to optimize costs and performance.
Experience
Data Engineer
Bank of America
Developed and maintained ETL processes by extracting data from HDFS and Hive, processing it in Apache Spark and IBM DataStage, and loading it into Oracle databases. Collaborated with cross-functional teams to design efficient data pipelines. Automated data workflows using AutoSys/Airflow. Led efforts in CI/CD for data pipelines. Successfully reduced the cost to the company by 50% by migrating the processing from IBM DataStage to Apache Spark.
Education
SRM Institute of Science and Technology, U.P
B.tech
Computer Science Engineering