Sagar Nalawade
@Sagar_Nalawade
Software Engineer at SMARTe Inc
Dombivli, Maharashtra, India
Data Engineer with 3 years of experience designing and operating large-scale distributed ETL pipelines on cloud platforms. Strong expertise in Apache Spark (Java), SQL, data warehousing concepts, and metadata-driven pipeline design. Hands-on experience with GCP and AWS ecosystems, building scalable batch processing frameworks handling 600–800M records per cycle. Experienced in working across cloud environments and distributed systems, with the ability to quickly adapt to new platforms such as Azure and Databricks based on strong fundamentals in Spark, SQL optimization, and data architecture.
Experience
Software Engineer
SMARTe Inc
• Engineered and maintained a critical ETL ecosystem with 25+ components, processing 600-800M records per cycle and improving stability and throughput. • Designed and implemented a Daily Data Pipeline (ingest ~20M/day to enriched output 20-30M/day), cutting data staleness from 1-3 months to under 48 hours. • Automated Dataproc cluster lifecycle (creation, autoscale, teardown) with SQL-driven configuration tables - eliminated idle compute and lowered cloud costs. • Architected a fully automated orchestration framework using Java, Shell, MySQL, and cron. • Implemented fault-tolerant job execution using MySQL checkpointing to support safe restarts, de-duplication prevention, and automatic failure detection. • Built a Spark SQL-based data quality & anomaly-detection module with automated reporting and pipeline-level failure prevention. • Reduced manual operational effort by 70-80% via end-to-end automation, monitoring, and runbook improvements. • Served as primary escalations engineer after the Tech Lead for RCA, debugging, and performance optimizations; mentored junior engineers. • Contributed to technical hiring by conducting interviews and evaluating candidates for junior data engineering roles.
Software Engineer
Amdocs
• Worked on enterprise-grade REST services and database modules. • Optimized Oracle SQL queries improving application performance.
Education
University of Mumbai
Bachelor of Engineering
Mechanical Engineering
CDAC, Sunbeam, Pune
Post Graduate Diploma in Advanced Computing
Computer Science
CDAC, PGDAC.