Kuralarasan K
@kuralarasan
Data engineer at Tata Consultancy Services
India
Kuralarasan K is a Data Engineer with over 3.5 years of experience specializing in Databricks, PySpark, and SQL. He has a proven track record of optimizing data pipelines, reducing processing times by up to 75%, and implementing GenAI-based solutions to automate manual workflows. At Tata Consultancy Services, he led data quality initiatives and migration projects from Oracle to Delta Lake. He is skilled in Azure Data Factory and building scalable ETL frameworks to ensure data reliability and performance.
Experience
Data engineer
Tata Consultancy Services
Designed and implemented end-to-end data migration pipelines using PySpark and Databricks to transform and load Oracle source data into harmonized Delta Lake target models. Developed scalable PySpark and Spark SQL applications. Optimized end-to-end data pipelines, reducing entity processing time from 12 hours to under 3 hours. Led the Data Quality Checks initiative, designing and implementing automated validation frameworks integrated into Databricks jobs. Achieved 30% compute cost reduction via SQL optimization and automated 12+ PySpark workflows.
Licenses & Certifications
Databricks Data Engineer Associate
Databricks