Default profile banner
VS

vivek sharma

@Vivek_sh99

Software Development Engineer I – Data Engineer at Polaris Smart Metering Pvt. Ltd.

Jaipur

Polaris Smart Metering Pvt. Ltd.Indian Institute of Information Technology (IIIT), Nagpur

Vivek Sharma is a Data Engineer with over two years of experience building large-scale ETL pipelines and analytics platforms for smart metering infrastructure. He currently processes data from approximately 12 million smart meters across three state deployments, handling 480 million records daily. Vivek is skilled in Python, PySpark, and AWS cloud services. His expertise includes master data management, grid reliability reporting, and geospatial analytics. He has also contributed to peer-reviewed research in deep learning.

Experience

Software Development Engineer I – Data Engineer

Polaris Smart Metering Pvt. Ltd.

Apr 2025 - PresentUP, Manipur & Ladakh

Engineered ETL pipelines on AWS Glue + PySpark to ingest and process telemetry for ~12 million smart meters. Built block load pipelines processing ~480 million records/day and monthly aggregation workflows consolidating ~14.4 billion records/month for DISCOM energy auditing. Designed and maintained network & administrative hierarchy master tables (MDM). Delivered DISCOM analytics modules covering reliability indices (SAIDI/SAIFI), voltage deviation, and load violations.

Junior Software Engineer

Intimetec

Jun 2022 - Oct 2023

Developed a Python-based cybersecurity automation tool integrating OWASP ZAP, Nikto, FFUF, Nmap, and Metasploit. Automated Active Directory management workflows using Python and Django, replacing manual PowerShell operations. Built Django REST API + PostgreSQL backend for centralised AD management and developed real-time monitoring dashboards.

Education

Indian Institute of Information Technology (IIIT), Nagpur

B.Tech

Electronics and Communications Engineering

Jan 2017 - Jan 2021

Skills

Python
SQL
ETL Pipelines
Batch Processing
Data Modelling
Data Lake Architecture
Master Data Management (MDM)
Data Governance
Dimensional Modelling
AWS Glue
AWS S3
AWS Athena
PySpark
Apache Spark
Parquet
AWS Lambda
PostgreSQL
MySQL
Smart Metering
AMI Analytics
HES/MDMS
RDSS
DISCOM Operations
Energy Auditing
Meter Lifecycle Management
Geospatial Analytics
SAIDI/SAIFI
Django
Django REST Framework
Grafana
Git
JIRA
Postman