VIVEK SHUKLA
@vshukla
Software Engineer II at HashedIn By Deloitte
Bangalore, India
Vivek Shukla is an experienced Software Engineer specializing in Data Engineering and full-stack development. He has expertise in Scala, Spark, and ETL processes, having designed and implemented pipelines processing over 10 million records at HashedIn By Deloitte. Proficient in Java, Spring Boot, and cloud technologies like AWS and Google Cloud Storage, he is skilled in optimizing complex data transformations and building robust web applications.
Experience
Software Engineer II
HashedIn By Deloitte
Designed and implemented pipeline to process structured data by integrating more than 10 million records from different sources using Scala and spark. Used Talend Data Studio tool to migrate data present in csv format to different destination such as Salesforce after complex transformations and joins. Implemented Re-run Logic to avoid duplication of records when rerunning the job and make job more efficient in terms of performance.
Software Engineer
HashedIn By Deloitte
Developed ETL script using Scala and spark to perform complex schema change for various data formats like csv, Json, parquet and orc. Reduced execution time of ETL script by more than 10 minutes after refactoring complex transformations. Used Google Cloud Storage to store the transformed data in containers and used BigQuery to query on the transformed data.
Software Development Engineer Intern
HashedIn By Deloitte
Developed the back-end APIs for a tool using which users can create, update or read the record in database. Developed the front-end services which gets, puts and updates the record in database using HTTP Client.
Technical Content Engineer
PrepBytes E-Learning
Created new problems with test cases and their editorials. Took Live sessions on various topics of Data Structures.
Education
ITS Engineering College
Bachelors of Technology
Computer Science
City Montessori School
ISC (Class XII)