Default profile banner
DY

DINESH YELLURI

@dineshyelluri

Lead Data Engineer at Quartic.ai

Bengaluru, India

linkedin.com/in/dinesh-kumar-yelluri

Quartic.aiBirla Institute of Science and Technology

Dinesh Kumar Yelluri is an astute Data Engineer with 8 years of experience designing and creating production-grade, low-latency solutions for high-frequency, high-volume data. He leverages novel techniques across technologies like Apache Spark, Kafka, and AWS/Azure to ensure maximum performance. His expertise includes building automated streaming pipelines and serving complex models in real-time.

Experience

Lead Data Engineer

Quartic.ai

•Invalid Date - Present•Bengaluru, India

Created and Automated pipeline and modeling for any type of sensor data to provide Regression, Anomaly Detection and Prediction based on user selection. Created streaming pipelines for Ingestion to Influx(Telemetry/Spectral/Discrete). Created unified streaming pipeline for User Rule Evaluation, Event frame and User Custom Expression evaluation services. Contribute to designing, building, and deploying high-performance production platforms using dockers. Created automated streaming data pipeline to serve 200 models within 10 core CPU power to provide real time predictions at low latency. Created a pipeline to serve 1000+ user created models and make predictions. Created connectors for IOT sources like MQTT, OPCUA, OSIPI etc.

Senior Software Engineer

Tavant Technologies

•Invalid Date - Invalid Date•Bengaluru, India

Worked on Re-engineering and Migrating data for Cobol - 600+GB of data containing 32+ diFerent data formats [Experian]. Worked on migrating multiple data sources from old mainframe environment to Hadoop ecosystem [Experian]. Worked on adding validations to new Bigdata based Credit user validation system [Experian]. Worked on creating a Lambda based pipeline for ingestion of data from 250+ greentea tables (Redshift) [Grubhub]. Created Azkaban, Presto, S3 based new ETL pipeline and migrated data for same [Grubhub]. Worked on creating Lambda based pipeline for clickstream events [Grubhub]. Worked on creating and optimizing Grubhub EMR based Cluster Management [Grubhub].

Software Engineer

TechMahindra

•Invalid Date - Invalid Date•Bengaluru, India

Worked on HBase based SMS/Voicemail storage platform use message conversion to byte array and stored per user with a retention [Comverse]. Worked on merging the Comverse Data Platfrom in Israel to global [Comverse]. Worked on a POC that crawls the web for information about diFerent mobiles and creates/updates the model weekly to predict the price of a second hand/refurbished mobiles and provides best price one can get for the selected mobile for given set of information about mobile [POC].

Education

Birla Institute of Science and Technology

Master of Technology

Data Science

Invalid Date - Invalid Date

Licenses & Certifications

Orielly Certified Apache Spark Developer

Issued: Invalid Date• No expiration

Databricks Developer Certification

• No expiration

Skills

Apache Spark(Streaming/Structured Streaming)
Apache Kafka(Kafka Connect/Kafka Streams)
Scala and Python
Dask
Hadoop
Flink
AWS/Azure
Influx
Postgres
Java
NoSQL
Hive
Pandas
ML
Airflow/Azkaban
Docker/Kubernetes
Elasticsearch
Design Pattern
Data structure
OOPS