Radha Tiwari
@user.2436826
Azure Data Engineer at Course5 Intelligence (C5I)
Pune, Maharashtra
Over 4+ years of experience as an Azure Data Engineer, specializing in Spark with Python and Spark-SQL for data extraction, transformation, and aggregation across various file formats. Proficient in Azure Data Factory, Azure Data Lake Storage, and Blob Storage, with a focus on optimizing PySpark applications. Skilled in developing Python functions, scheduling jobs, and deploying notebooks for data processing. Experienced in optimizing code performance using best practices and techniques. Strong analytical and problem-solving skills, with experience in relational databases like Oracle and MySQL.
Experience
Azure Data Engineer
Course5 Intelligence (C5I)
Client: MARS. Used pre-configured Service Principal to securely retrieve silver and gold layer data from ADLS Gen2. Transformed data to Delta format using PySpark in Databricks. Implemented data quality transformations in silver layer. Automated data pipelines with Azure Data Factory. Optimized performance with Delta Lake features.
Azure Data Engineer
Muplant Technologies Pvt. Ltd.
Developed ETL pipelines using Azure Data Factory. Built data transformation workflows in Azure Databricks. Optimized data storage in ADLS Gen2. Integrated data from SQL Server, Oracle, and other sources into Health and Insurance Data Mart on Azure. Developed PySpark scripts for data validation.
Education
Government College of Engineering Aurangabad
Master of Technology (M-Tech)
Deogiri Institute of Engineering and Management Studies Aurangabad
Bachelor of Technology (B-Tech)
Licenses & Certifications
Databricks Certified Data Engineer Associate
Databricks
Credential ID: 122087188
Microsoft Certified: Azure Data Engineer Associate
Microsoft
Credential ID: 643DF122BDE656CD