Default profile banner
AV

Anshul Vijay

@Anshul

Associate Data Engineer at Celebal Technologies

Jaipur

Celebal TechnologiesJECRC University

Goal-oriented Data Engineer with 3+ years of experience, specializing in building scalable data pipelines and analytics-ready datasets. Techno-functional and solution-driven, with strong critical thinking skills and hands-on experience working in Agile (Scrum) environments with cross-functional teams. Known for supporting global clients, resolving complex data issues, and delivering reliable, high-quality data solutions.

Experience

Associate Data Engineer

Celebal Technologies

•Present•Jaipur

Hands-on experience in designing and delivering enterprise-scale data platforms using Azure Databricks, Py Spark, Delta Lake, Azure Data Factory (ADF), and ADLS Gen2. Designed and implemented end-to-end data ingestion pipelines using ADF and Databricks Auto Loader. Implemented Medallion Architecture (Bronze, Silver, Gold). Developed robust transformation logic and complex business rules using PySpark. Applied Databricks performance optimization techniques including partitioning, Z-Ordering, and Delta optimizations. Implemented governance and security using Unity Catalog. Worked extensively with Snowflake and DBT for data warehousing and modelling. Built and maintained CI/CD pipelines using Azure DevOps and Git. Led Snowflake to Databricks migration initiatives. Built and managed Delta Live Tables (DLT) pipelines. Managing a team of 5 direct-report engineers.

Education

JECRC University

Bachelor of Technology

Computer Science and Engineering

Jan 2019 - Jan 2023

Licenses & Certifications

Databricks Certified Data Engineer Associate

Databricks

• No expiration

Databricks Certified Data Engineer Professional

Databricks

• No expiration

Databricks Accredited Generative AI Fundamentals

Databricks

• No expiration

Microsoft Certified: Fabric Data Engineer Associate

Microsoft

• No expiration

Microsoft Certified: Azure Data Engineer Associate

Microsoft

• No expiration

Skills

Databricks
Py Spark
Hadoop
DLT Python
Unity Catalog
Data Modelling
Databricks Optimization
SQL
MYSQL
Serverless cluster
Synapse
ADF
Azure
AWS
GIT (Gerrit)
Bitbucket
Azure DevOps
Data Warehousing
Snowflake
Star Schema
Snowflake Schema
Agile Scrum Boards - Jira
Autoloader
Delta Tables
Versioning
Data build tool (DBT)
Fivetran
SAP
Airflow
Agile (Scrum) Methodologies
Teamwork
Leadership
Ownership capabilities