Dinesh Goudar
@dineshgoudar
Big Data Engineer at Tata Consultancy Services
Bengaluru, India
A Big Data Engineer with 3 years of hands-on experience creating robust Data Pipelines on AWS, designing efficient ETL workflows using Informatica PowerCenter, and building REST API services. Proficient in Python, Pyspark, and SQL, demonstrating expertise in developing scalable and high-performance solutions.
Experience
Big Data Engineer
Tata Consultancy Services
Collaborated with financial business product owners to extract and document requirements, and led the implementation through agile development processes. Developed PySpark jobs for ingesting data from third-party systems, transform and load it to S3 as Parquet/Glue table using AWS EMR. Created and managed IAM roles, policies, SNS topics, Security Groups, Lambda functions, and API Gateway configurations using Cloud Formation. Developed REST API services on AWS Lambda using Python for a home office financial app. Created event-driven AWS Lambdas, such as database insert triggers and S3 object event-driven Lambda invocations. Created change data capture (CDC) mappings to efficiently track and manage changes in data over time using Informatica Powercenter. Have experience creating Data Models for data pipelines. Worked on scheduling batch jobs using Tidal Automation tool as per the requirements. Have experience implementing the Business As Usual(BAU) features for batch processing pipelines.
Education
KLE Technological University
Bachelor of Engineering
Automation & Robotics
Licenses & Certifications
Informatica Powercenter Developer
AWS Certified Cloud Practitioner
Nvidia's Fundamentals of Deep Learning for Computer Vision
Nvidia