LGLakshay Goel is a Big Data Engineer with 7.9 years of extensive experience designing and developing complex data solutions. He possesses strong expertise in technologies such as Apache Spark, Airflow, and Kafka. His professional background includes developing robust ETL pipelines, implementing prioritization logic, and managing Azure migrations.
Experience
Senior Software Engineer
Optum - United Health Group
Developed and designed Spark Scala module for data ingestion. Developed and designed Spark Scala module for daily reporting. Worked on Python framework to implement Priortisation and Aggregation logic. Developed Airflow Dags to Schedule jobs. Worked on Azure Migration.
Technology Analyst
Infosys Limited
Developed and designed ETL pipeline using Spark Scala. Developed and designed Spark Scala module for generating monthly extracts of data. Developed Airflow dags to Schedule Spark jobs.
Education
National Institute Of Technology, Hamirpur (H.P.)
B.Tech
Computer Science and Technology
Licenses & Certifications
Azure Fundamentals (AZ-900)
Azure Data Fundamentals (DP-900)