Bharath Barla
@BharathKumar
Data Engineer at MuSigma Business solutions
Bangalore
3.2 years of experience in the industry, including 3 years as a Data Engineer with expertise in Databricks, PySpark, and Azure Data Engineering solutions. Proven skills in designing data pipelines, optimizing large-scale data workflows, and ensuring data integrity.
Experience
Data Engineer
MuSigma Business solutions
Designed and optimized end-to-end data pipelines using ADF and Databricks. Developed workflows in Azure Databricks, enhancing large-scale data transformations. Implemented monitoring, error-handling, and data validation processes. Directed the development and deployment of Azure Cloud integration applications to connect disparate systems and streamline data flow across the enterprise. Designed and implemented automated solutions for real-time data refresh and improving system scalability and responsiveness. Transformed and prepared the data as per the business requirements for the respective Spotfire reports by using Azure Databricks with the help of PySpark framework and loaded it to Azure SQL DB. Collaborated with stakeholders to gather requirements, define project scope, and ensure alignment with business objectives. Provided technical leadership and mentorship to team members. Actively participated in Agile development processes, including sprint planning, daily stand-ups, and sprint reviews. Developed CI/CD pipelines to deploy code to other Instances (Dev/QA/Prod) using GitHub.
Education
Bharath institute of higher education and research
Bachelor of Technology (B.Tech)
Computer Science and Engineering
Narayana Junior College
Intermediate
M.P.C
Abhyudaya High School
Secondary High School