Rushabh Dhabe
@rushabhdhabe
Data Engineer at Sustine Solutions Pvt Ltd
Pune, Maharashtra
Skilled AWS Data Engineer with 2+ yrs experience in ETL pipelines using AWS Glue, optimizing Spark data pipelines. Expertise in developing and implementing complex data pipelines, maintaining data warehouses, and managing big data solutions. Proficient in programming languages like Python and SQL, and experience working with Hadoop, Spark, and AWS services.
Experience
Data Engineer
Sustine Solutions Pvt Ltd
Developed and managed ETL pipelines to transfer Finance data from various sources (databases, APIs, flat files) to Snowflake for reporting and analysis. Responsible for analyzing and cleansing raw data using Glue Jobs, developing, and monitoring scripts using Glue PySpark, and optimizing code for better performance. Provided technical support and guidance to business users.
Data Engineer
Sustine Solutions Pvt Ltd
Created a data pipeline for data loaded in S3 from on-premises servers using DMS and exported into Glue for transformations. Data was loaded, transformed, and normalized with PySpark and loaded into AWS Redshift. Focused on efficient and scalable data migration, ensuring data integrity and security. Responsible for monitoring and optimizing data flow to minimize processing time.
Education
MGM's Dr. GY Pathrikar college of CS and IT, Chh. Sambhaji Nagar
Bachelor of Computer Science
Computer Science
Maharashtra Institute of Technology, Chh. Sambhaji Nagar
Masters of Computer Applications
Computer Applications