Rahul Varma Vanyala
@rahulvarmavanyala
Big Data Engineer at Micron Technology
Hyderabad
Rahul Varma Vanyala is a data professional with four years of experience in analytical solutions, utilizing Python, R, SQL, Hadoop, and Apache Nifi. He specializes in optimizing data pre-processing and ETL processes to derive actionable insights. His expertise includes working with various big data platforms such as Snowflake, Hive, and GCP BigQuery, alongside strong skills in stakeholder management and complex data pipeline development.
Experience
Big Data Engineer
Micron Technology
Supporting Micron applications by enhancing and resolving pipelines within SLA, working with Apache NIFI, Mssql, Hive, oracle, Snowflakes, and GCP Big query. Automated monitoring for applications using Apache NIFI, reducing operational work by 90%.
Data Engineer
InnData Analytics Pvt. Ltd.
Developed ETL pipelines from diverse sources (csv, avro, json, unstructured data) using Apache NIFI for real-time data ingestion. Developed an Rss Feed pipeline to mongoDB using Streamsets and executed pre-processing with Named Entity Recognition using Python. Transitioned 350 terabyte data from old to new Hadoop clusters using Shell and NIFI, and optimized NIFI workflows.
Data Science Intern
Gempulse Infotech Pvt ltd
Conducted Click Track Analysis using Python and SQL, integrating SQL databases with Python and pre-processing data for ML Model input. Visualized user behavior data based on display Id, Ad Id, and Time.
Education
Manipal Academy of Higher Education
Post Graduate Diploma - Data Science
Data Science
B V Raju Institute of Technology
B.Tech.
Computer Science
Sri Chaitanya Junior college
12th