Avinash Elangovan

Expertise in Azure Data Engineering, Big Data Processing, and Machine Learning, working with cutting-edge tools. Proficient in developing and optimizing ETL pipelines using Databricks, Apache Spark, and Delta Lake. Advanced knowledge of Azure cloud platforms including ADLS, Synapse Analytics, and ADF. Strong programming skills in SQL, PySpark, and Python, with experience in managing CI/CD pipelines using Azure DevOps and optimizing Spark performance.

Defined and designed overall system architecture and developed clear data models. Developed end-to-end scripts to automate data collection using complex business logic. Provided warranty support post-UAT and Go Live, ensuring smooth transition and addressing post-launch issues.

Designed and optimized complex Datastage pipelines for integrating data from multiple heterogeneous sources. Proficient in ETL tasks, implementing normalized, star, and snowflake schemas. Strong expertise in Linux environments for ETL job scheduling and script automation. Skilled in writing complex Teradata SQL queries and managing data transformations.

Completed comprehensive training on Informatica PowerCenter and DataStage. Proficient in designing, developing, and debugging ETL jobs to extract, transform, and load data from various sources. Developed complex data transformation logic and ensured high-quality data migration.