Milan Harindran
@milanharindran
Data Engineer | PySpark | Databricks | SQL | Python | AWS | ETL
Kochi
Data Engineer with 2+ years of professional experience building data pipelines and analytics workflows using Python, SQL, and PySpark. Experienced in designing ETL processes, transforming raw datasets into analytics-ready data, and working with distributed data processing frameworks such as Apache Spark and Databricks. Passionate about building scalable data platforms and continuously improving data quality, reliability, and performance
Experience
Software Engineer
Redblack Software
Leveraged .NET and SQL to implement backend features for a cloud-based fintech platform on AWS, supporting multi-tenant workflows in an Agile environment. Handled high-volume transactional datasets used for reporting, analytics, and operational workflows in a fintech platform. Investigated production data issues using SQL, data analysis to diagnose and resolve workflow defects. Performed root-cause analysis using application logs and database queries to resolve data-related defects and improve reliability. Implemented backend enhancements in C# for an Update Statistics workflow integrated with Jenkins, enabling on-demand execution across tenants and supporting SRE monitoring and maintenance operations. Developed backend logic to support tenant-level outage windows, allowing scheduled suspension and returning retry headers for operations to ensure graceful handling during maintenance. Delivered ~13% build time improvement through contributions to SDK migration to .NET Core and build process optimization. Worked with transactional datasets and SQL queries to analyze production data and support analytical workflows.
Education
BITS Pilani
Master of Technology
Data Science and Engineering
Rajagiri School of Engineering and Technology
Bachelor of Technology
Computer Science and Engineering