
HSHarshal Shinde
@Harshal_Shinde
Data Engineer | ETL/ELT Developer | Python | SQL | Spark | IITian
Nashik, Maharashtra, India
Data Engineer with around 3+ years of experience designing, building, and optimizing scalable ETL pipelines and data warehousing solutions using SQL, Python, and Apache Spark on Google Cloud Platform (GCP). Skilled in data modeling, data quality, and automation, with proven success supporting analytics and reporting for distributed, agile teams. Strong communicator with a continuous improvement mindset, adept at leveraging emerging tools to deliver business value and actionable insights.
Experience
Data Engineer
Sanvar Technology Pvt Ltd
- ETL Optimization & Performance Enhancement: Engineered and optimized SQL-based ETL pipelines for large-scale datasets, achieving a 30% reduction in data processing latency. - Workflow Orchestration & Automation: Orchestrated end-to-end data ingestion and transformation workflows leveraging Apache Airflow, dbt, BigQuery, and Dataflow, ensuring seamless and scalable data operations. - Analytical Data Modeling: Designed and implemented high-performance analytical data models in BigQuery, enhancing BI query efficiency by 25% and enabling faster decision-making. - Data Quality & Governance: Instituted comprehensive rule-based data validation and quality checks, mitigating data discrepancies and minimizing reprocessing overhead.
Associate Solution Leader, Data Engineer
Brane Enterprises pvt ltd
- ETL Architecture & Automation: Architected scalable ETL pipelines, streamlining data workflows & reduced manual intervention by 40%. - SQL Performance Tuning & Optimization: Optimized SQL queries and implemented indexing strategies, enhancing data access and query performance by 20%. - CI/CD Deployment & Pipeline Efficiency: Deployed automated CI/CD pipelines, accelerating deployment cycles by 50% and ensuring seamless data delivery. - Data Security & Reliability: Established secure and resilient data processing pipelines, guaranteeing reliability for client analytics workloads.
Software Engineer
Aress Software and Technology pvt ltd
- ETL Workflow Automation: Streamlined ETL workflows leveraging Python and SQL, mitigating manual errors by 90% and enhancing operational efficiency. - Data Transformation & Analytics Enablement: Developed robust data cleaning, transformation, and reporting scripts to support diverse analytics use cases and drive actionable insights. - Production Issue Resolution & Pipeline Reliability: Diagnosed and resolved 150+ production data incidents, improving overall pipeline reliability by 15%.
Education
Indian Institute of Technology, Jodhpur
Master of Technology
Data Engineering
Departmental Rank 53rd
R H Sapat College of Engineering, Nashik, India
Master of Computer Applications (MCA Engineering)
Licenses & Certifications
Full Stack Data Science
iNeuron
Certified Hyperledger Fabric Administrator (CHFA)
Linux Foundation
Red Hat Certified System Administrator (RHCSA)
Red Hat