Default profile banner
MV

Mahendranath V K

@user.2460803

Data Engineer at Tata Consultancy Services

Chennai, Tamil Nadu

Tata Consultancy ServicesSRM Institute of Science and Technology

Results-driven Data Engineer with almost 3 years of experience in designing and optimizing large-scale data pipelines and analytics solutions. Adept at designing, developing and maintaining Data Stores including Databases, Data Warehouses and Data Lakes. Proficient in Python and PySpark, skilled in AWS cloud services and big data technologies including Apache Hadoop, Spark, Sqoop and Hive.

Experience

Data Engineer

Tata Consultancy Services

Full-time•Jul 2022 - Present•Chennai, Tamil Nadu

Designed and developed multiple Data Pipeline Architectures (ETL/ELT) leveraging AWS EMR, Glue and Lambda. Reduced ETL processing time by 35%. Optimized data models reducing storage consumption by 25% and improving query performance by 35%. Enhanced Athena queries reducing runtime by 40% and cutting data scanning costs by 30%. Transitioned ETL jobs from EMR to Lambda achieving 50% cost reduction. Achieved 95% code coverage with Pytest. Productionized a Deep Learning Neural Network scoring algorithm for 610K associates. Patent filed with Govt. of India.

Education

SRM Institute of Science and Technology

Bachelor of Technology

Computer Science Engineering

Jan 2022

AVMR Matriculation Higher Secondary School

HSC

Jan 2018

Licenses & Certifications

AWS Certified Data Engineer Associate

Amazon Web Services

Skills

Python
PySpark
Apache Spark
Apache Hadoop
Apache Hive
Apache Sqoop
AWS S3
AWS RDS
AWS Redshift
AWS Athena
AWS Lambda
AWS EMR
AWS Glue
AWS Lake Formation
AWS SNS
PostgreSQL
MongoDB
Docker
Git
Pandas
Machine Learning
SQL
NoSQL
Data Pipeline Development
ETL
Data Modeling