AKHIL ANAND
@akhilanand
Azure Data Engineer
Chennai, TamilNadu, India
Azure Data Engineer with 4 years of experience in designing, implementing, and optimizing cloud-based data solutions. Proficient in leveraging Azure data services such as Azure Data Factory, Azure Synapse Analytics, and Azure SQL Database to build scalable ETL pipelines and data architectures. Expertise in data migration, transformation, and integration with a solid foundation in writing complex SQL queries for data warehousing, and performance optimization.
Experience
Senior IT Engineer - Data Analytics & AI
Johnson Electric Private Limited
• Oracle OnPremise Datawarehouse to Cloud migration using Microsoft Azure Synapse, resulting in cost savings and increased data accessibility and adaptability in Power BI reports. • Designed and implemented over 30+ real-time data pipelines to process structured and semi-structured data by integrating raw data from multiple sources using PySpark and SQL. Developed Synapse notebooks using PySpark and Spark SQL to address complex queries and transformations defined in Informatica Workflows. • Developed and Implemented 30 Data Pipelines using Azure Synapse Analytics and SQL Server Stored Procedures. Collaborated with team to design and implement generic data frame Notebooks in Synapse for wider usage in custom workflows. • Implemented data quality framework in Synapse Notebook which can be used in multiple workflows with no changes; to ensure the data effectiveness, redundancy and ease of data addressing. • Developed Azure Logic App flows to notify the users about data quality issues at the source system end and alert the BAU Team to monitor and check the Pipeline run status. • Improved data pipeline performance by enhancing the SQL Database table concerning table distributions, indexing, and optimizing SQL queries. • Developed a basic ticketing application using Microsoft Power Apps and Microsoft Power Automate for the end users to raise support tickets and the Admin to acknowledge the user's. • Worked on data validation and testing of the Synapse pipelines and optimised the SQL queries for better performance and running cost.
Programmer Analyst Trainee
Cognizant Technology Solutions
• Worked as a developer in Cognizant with 2 years of experience in Microsoft Azure Cloud Technology, SQL Server. • Experience working on data load from source systems to Azure Storage and SQL database using Azure Data Factory, Databricks and SQL Server. Data cleansing, transformations and data quality checks are defined on the source data based on the business requirement and Data warehousing concepts. • Experience in Azure Data Factory Pipelines, Azure Data Lake, Azure Blob, Triggers, Linked Services, Datasets. • Worked on ADLS Gen1 to Gen2 migration activities validated the Pipelines to migrate the data source from Gen1 to Gen2. • Performed data validation and debugging for various pipeline modules and data. Worked on ADLS Gen1 to Gen2 migration activities validated the Pipelines to migrate the data source from Gen1 to Gen2. • Key experience in Azure Key Vaults to manage and store secrets that can be referred in ADF activities and Notebooks while maintaining confidentiality.
Education
Vidya Jyothi Institute of Technology
Bachelor of Technology (B.Tech)
Electronics and Communication Engineering
Mahaveer Institute of Science & Technology
Polytechnic (Diploma)
Electronics and Communication Engineering
Licenses & Certifications
Certification in Electronics System Design and Manufacturing (ESDM)
Telecom Sector Skill Council (TSSC)