Bhanu Nattala

Designed and implemented end-to-end metadata-driven data pipelines in Azure Data Factory(ADF), enabling dynamic and reusable ETL workflows. Leveraged Databricks Delta Lakehouse to build a highly performant and reliable data lake, enabling efficient data exploration and analysis. Spearheaded the development and implementation of storage solutions, utilizing Azure Data Lake Gen2 and Azure Data Explorer for efficient data retrieval and storage. Implemented Databricks Unity Catalog for centralized data governance, fine-grained access control, and improved security across different workspaces. Developed complex data transformations using PySpark and SparkSQL within Databricks, automating data cleansing and enrichment processes, resulting in a 30% reduction in manual effort. Collaborated with cross-functional teams to gather data requirements and translate them into scalable and maintainable data solutions. Maintained detailed documentation for production support processes, issue resolution steps, and system configurations to facilitate knowledge sharing and continuity.