HBHarshal Bhadke
@bhadkeharshal
Data Engineer at Tata Consultancy Services
Pune, Maharashtra, India
Innovative and results-driven Data Engineer(3 Years) with over 5 years of experience in IT services. Specialized in Big Data and proven expertise in designing and implementing efficient data pipelines, particularly with AWS technologies. Strong communication and client handling skills, adaptable in both small and large team environments.Also implemented GitHub Copilot
Experience
Data Engineer
Tata Consultancy services- Designed and implemented a data pipeline for IFRS 17 compliance, enhancing financial reporting. - Developed and orchestrated a serverless data pipeline using AWS Step Functions for streamlined. - Leveraged AWS Lambda for dynamic configuration management and streamlined data processing. - Utilized PySpark for data transformations, ensuring data cleansing and standardization. - Configured Amazon S3 for data staging and Redshift as the data warehouse for final reporting datasets. - Monitored and optimized pipeline performance using Amazon CloudWatch, ensuring high availability. -Familiarity with AI-assisted development tools such as GitHub Copilot to enhance productivity and code quality.
Software Engineer
Atyeti Inc
- Assisted in the development and implementation of ETL processes tailored to client needs. - Collaborated with stakeholders to ensure proper dataset identification and usage. - Advised stakeholders on industry best practices for data handling and processing. - Developed SQL scripts for data extraction and transformation, improving data accuracy significantly.
Education
Prof Ram Meghe Institute of Technology and Research
Bachelor of Engineering
Electronic and Telecommunications