Default profile banner
PK

Pranav Kalwad

@Pranav_Kalwad

Associate Data Engineer at phData

Bengaluru, Karnataka, India

phDataPES University

Associate Data Engineer at phData with a Bachelor of Technology in Computer Science from PES University. Experienced in Big Data technologies including Snowflake, dbt, Apache Spark, and cloud platforms like Azure and AWS. Specialized in building Data Mesh foundations, automating ETL processes, and optimizing analytical models. Certified Databricks Data Engineer Associate and Snowflake Snowpro Core.

Experience

Associate Data Engineer

phData

•Aug 2024 - Present•Bangalore, India

Biotechnology Research: Data Mesh Foundation and Data platform modernization. Engineered generic incremental macros to automate ETL logic for three major SAP sources during a Data Mesh migration. Optimized complex analytical models by strategically leveraging dbt materialization configurations, achieving an 80% reduction in model runtime. Orchestrated and implemented a comprehensive TDD paradigm for data quality assurance in the Data Mesh. HRMS: Multi-Engine Data warehouse platform setup. Engineered multi-engine dbt macros leveraging Snowflake and Redshift adapters. Automated dbt model validation using Airflow and Trino. Engineered SHA2 hash validation using an Agentic framework (Cursor IDE) between Redshift and Snowflake. Implemented a proactive governance utility using dbt Great Expectations and Grafana. Designed an efficient Python script to automate data loading from Redshift to Snowflake. Engineered a Python script utilizing Snowpark and cloud staging (GET/PUT) to automate the chunked, parallel replication of 10M+ row tables across Snowflake accounts. Developed a POC integrating Mapbox API via Snowflake External Functions and custom UDFs. Authored technical blog on Snowflake a

Education

PES University

Bachelor of Technology

Computer Science

Dec 2020 - Jun 2024

Licenses & Certifications

Databricks Certified Data Engineer Associate

Databricks

• No expiration

Snowflake Snowpro Core

Snowflake

• No expiration

Snowflake Native Apps certification

Snowflake

• No expiration

Skills

Apache Spark
Pyspark
Apache Hive
Databricks
Snowflake
Apache Airflow
Apache Trino
Azure Data Factory
ADLS Gen2
Key Vault
Azure DevOps
Redshift
Glue
Athena
S3
SNS
EMR
AWS Python SDK
Informatica
dbt
Python
SQL
Bash/Shell Scripting
Git
GitHub Actions
MSSQL