Default profile banner
DG

Dinesh Goudar

@dineshgoudar

Big Data Engineer at Tata Consultancy Services

Bengaluru, India

https://www.linkedin.com/in/dineshgoudar

Tata Consultancy ServicesKLE Technological University

A Big Data Engineer with 3 years of hands-on experience creating robust Data Pipelines on AWS, designing efficient ETL workflows using Informatica PowerCenter, and building REST API services. Proficient in Python, Pyspark, and SQL, demonstrating expertise in developing scalable and high-performance solutions.

Experience

Big Data Engineer

Tata Consultancy Services

•Jan 2021 - Present•Bengaluru, India

Collaborated with financial business product owners to extract and document requirements, and led the implementation through agile development processes. Developed PySpark jobs for ingesting data from third-party systems, transform and load it to S3 as Parquet/Glue table using AWS EMR. Created and managed IAM roles, policies, SNS topics, Security Groups, Lambda functions, and API Gateway configurations using Cloud Formation. Developed REST API services on AWS Lambda using Python for a home office financial app. Created event-driven AWS Lambdas, such as database insert triggers and S3 object event-driven Lambda invocations. Created change data capture (CDC) mappings to efficiently track and manage changes in data over time using Informatica Powercenter. Have experience creating Data Models for data pipelines. Worked on scheduling batch jobs using Tidal Automation tool as per the requirements. Have experience implementing the Business As Usual(BAU) features for batch processing pipelines.

Education

KLE Technological University

Bachelor of Engineering

Automation & Robotics

Jan 2017 - Jan 2021

Licenses & Certifications

Informatica Powercenter Developer

AWS Certified Cloud Practitioner

Nvidia's Fundamentals of Deep Learning for Computer Vision

Nvidia

Skills

Amazon Web Services (AWS)
IAM
S3
CloudFormation
EMR
Lambda
EC2
SNS
Athena
API Gateway
Python
PySpark
Pandas
Hadoop
Apache Spark
SparkSQL
Informatica Powercenter
SQL
PostgreSQL
MySQL
RESTful API
Data Modeling
Agile
Jira
Git
Service Now
Tidal Automation
Unix Systems