Bali Reddy
@Bontha_Bali_Reddy
Data Engineer at Nayagara Technologies Limited
Bengaluru
Data Engineer with 3 years of experience in designing, building, and optimizing scalable data pipelines using Python, SQL, PySpark, and Azure Databricks. Experienced in ETL, data warehousing, and big data solutions, delivering reliable and high-performance analytics for business needs.
Experience
Data Engineer
Nayagara Technologies Limited
Extracted data from Oracle databases and integrated it into Azure SQL using ADF; sourced JSON files from ADLS for transformation. Used PySpark and Azure Databricks to process large datasets and perform analytics. Developed pipelines to provide data-driven insights for decision-making and deployed data transformation and analytics code in Databricks. Optimized PySpark jobs and data pipelines for improved processing speed and resource utilization. Designed and implemented scalable data pipelines for handling large data transformations. Ensured data integrity and applied validation techniques throughout the ETL process. Analyzed logs, performed unit testing, and optimized Spark jobs for better performance.
Education
Sanghai International University
BSC
Computer Science
Andhra Loyola College
Intermediate
SKML Vidhya Mandhir High School
SSC