Harshal Shinde's profile banner
Harshal ShindeHS

Harshal Shinde

@Harshal_Shinde

Data Engineer | ETL/ELT Developer | Python | SQL | Spark | IITian

Nashik, Maharashtra, India

Sanvar Technology Pvt LtdIndian Institute of Technology, Jodhpur

Data Engineer with around 3+ years of experience designing, building, and optimizing scalable ETL pipelines and data warehousing solutions using SQL, Python, and Apache Spark on Google Cloud Platform (GCP). Skilled in data modeling, data quality, and automation, with proven success supporting analytics and reporting for distributed, agile teams. Strong communicator with a continuous improvement mindset, adept at leveraging emerging tools to deliver business value and actionable insights.

Experience

Data Engineer

Sanvar Technology Pvt Ltd

Full-timeOct 2023 - Mar 2024Hyderabad, Telangana, India

- ETL Optimization & Performance Enhancement: Engineered and optimized SQL-based ETL pipelines for large-scale datasets, achieving a 30% reduction in data processing latency. - Workflow Orchestration & Automation: Orchestrated end-to-end data ingestion and transformation workflows leveraging Apache Airflow, dbt, BigQuery, and Dataflow, ensuring seamless and scalable data operations. - Analytical Data Modeling: Designed and implemented high-performance analytical data models in BigQuery, enhancing BI query efficiency by 25% and enabling faster decision-making. - Data Quality & Governance: Instituted comprehensive rule-based data validation and quality checks, mitigating data discrepancies and minimizing reprocessing overhead.

Associate Solution Leader, Data Engineer

Brane Enterprises pvt ltd

Full-timeFeb 2023 - Sep 2023Hyderabad, Telangana, India

- ETL Architecture & Automation: Architected scalable ETL pipelines, streamlining data workflows & reduced manual intervention by 40%. - SQL Performance Tuning & Optimization: Optimized SQL queries and implemented indexing strategies, enhancing data access and query performance by 20%. - CI/CD Deployment & Pipeline Efficiency: Deployed automated CI/CD pipelines, accelerating deployment cycles by 50% and ensuring seamless data delivery. - Data Security & Reliability: Established secure and resilient data processing pipelines, guaranteeing reliability for client analytics workloads.

Software Engineer

Aress Software and Technology pvt ltd

Full-timeSep 2021 - Jan 2023Nashik, Maharashtra, India

- ETL Workflow Automation: Streamlined ETL workflows leveraging Python and SQL, mitigating manual errors by 90% and enhancing operational efficiency. - Data Transformation & Analytics Enablement: Developed robust data cleaning, transformation, and reporting scripts to support diverse analytics use cases and drive actionable insights. - Production Issue Resolution & Pipeline Reliability: Diagnosed and resolved 150+ production data incidents, improving overall pipeline reliability by 15%.

Education

Indian Institute of Technology, Jodhpur

Master of Technology

Data Engineering

PresentGrade: 7.51

Departmental Rank 53rd

R H Sapat College of Engineering, Nashik, India

Master of Computer Applications (MCA Engineering)

Jan 2021

Licenses & Certifications

Full Stack Data Science

iNeuron

• No expiration

Certified Hyperledger Fabric Administrator (CHFA)

Linux Foundation

• No expiration

Red Hat Certified System Administrator (RHCSA)

Red Hat

• No expiration

Skills

Data Engineering
ETL/ELT Development
Data Pipeline Optimization
Data Modeling
Data Warehousing
Data Quality Management
Analytics-Ready Datasets
Workflow Automation
Scalable Data Architecture
Business Intelligence Enablement
SQL
Python
Apache Airflow
dbt
Apache Spark
PySpark
Kafka
AWS
Redshift
AWS Glue
MWAA
EMR
S3
Azure
Synapse
Snowflake
Data Factory
ADF
Databricks
ADLS
Blob
GCP
BigQuery
Dataflow
Dataproc
Cloud Composer
Cloud Storage
MySQL
SQLite
RDS
Azure SQL
Cloud SQL
Pandas
NumPy
EDA
Feature Engineering
Machine Learning
Tableau
Streamlit
Plotly