Thiruvenkadam S

@user.2583894

Big Data Engineer | Apache Spark | Hadoop | AWS

Chennai, Tamil Nadu, India

https://www.linkedin.com/in/thiruvenkadam-s-95b885191/

Cognizant Technology SolutionsSt. Joseph's Institute of Technology

Thiruvenkadam S is a results-driven Big Data Engineer with 2.6+ years of experience at Cognizant Technology Solutions, specializing in Apache Spark, Hadoop, and AWS cloud technologies. He has designed and implemented scalable data processing frameworks, real-time streaming applications using Kafka and Spark Streaming, and a generic Oracle-to-S3 data transfer framework achieving transfers in under 10 minutes. He holds a B.E. in Computer Science and Engineering from St. Joseph's Institute of Technology, Chennai.

Experience

Big Data Engineer

Cognizant Technology Solutions

•Aug 2022•Chennai, Tamil Nadu, India

Designed and implemented data processing frameworks using Apache Spark and Hadoop. Developed real-time streaming applications with Spark Streaming and Kafka. Managed data storage on AWS S3 and EMR. Client: Charter Communications — developed streaming and batch applications handling data from Kafka, Hive, HDFS, S3, SQL.

Education

St. Joseph's Institute of Technology

Jun 2018 - May 2022

Chennai, Tamil Nadu

Licenses & Certifications

AWS Cloud Practitioner

Amazon Web Services

Databricks Certified Data Engineer Associate

Databricks

Skills

Apache Spark

Hadoop

HDFS

Hive

HBase

Kafka

Scala

PySpark

AWS EMR

AWS S3

AWS EC2

Apache Airflow

Apache NiFi

Tidal Enterprise Scheduler

SQL

NoSQL

Spark Streaming

Shell Scripting

Oracle