Default profile banner
AK

Abhishek Kumar

@AbhishekKumaa11

Data Engineer at Harmony Data Integration Technologies

Chandigarh, India

Harmony Data Integration TechnologiesLovely professional University

Data Engineer with over 4 years of experience building scalable ETL pipelines and real-time data systems. Proven track record in processing 5M+ daily events with 99.9% reliability using GCP, AWS, and a modern data stack. Google Cloud Certified Professional Data Engineer specializing in high-performance data solutions for live sports and enterprise applications.

Experience

Data Engineer

Harmony Data Integration Technologies

May 2023 - PresentMOHALI, PB

LIV Golf: Architected real-time ETL pipelines and data warehouse on GCP (BigQuery, Firestore, Pub/Sub, Dataflow) for live tournament data. Enabled seamless delivery to millions of golf fans worldwide with sub-second latency. Deployed CI/CD pipelines on Cloud Run ensuring 99.9% uptime during live events. Built secure API integrations with Apigee for supplier data exchange. Brighton: Engineered high-throughput ETL pipelines ingesting streaming data into Google BigQuery. Delivered real-time analytics and reporting for business intelligence teams. IRFU Irish Rugby Football Union: Automated manual Excel workflows using Python and Pandas. Reduced operational overhead by 85% and eliminated human error in CRM data updates.

Python/Django Developer

NetSet software solution

Oct 2022 - Apr 2023MOHALI, PB

UINONE: Designed RESTful APIs using Django and AWS supporting 20K+ active users. Implemented real-time chat with WebSockets, boosting engagement by 25%. Enabled seamless social interactions with secure and scalable backend architecture.

Python/Django Developer

Innovative e-Solutions Enterprise

Mar 2021 - Oct 2022PANCHKULA, HR

Aurora: Developed and deployed a REST API using Django REST Framework to support scalable data access and integration. Implemented GitHub OAuth 2.0 for secure authentication and automated retrieval of repository data. Designed data models and API endpoints to visualize collaboration metrics and portfolio insights. Deployed services on AWS EC2 with RDS (MySQL) and optimized performance for production workloads. DuVal Partners: Engineered a RESTful API platform using Django REST Framework for property investment management. Integrated GitHub OAuth 2.0 for user data synchronization and repository-level access control. Designed and optimized database schemas and query logic to ensure high performance and scalability. Enhanced API reliability and maintainability through modular code structure and robust exception handling.

Education

Lovely professional University

BCA

Jan 2023 - Feb 2025

Shri Markendeshwar Polytechnic, Lotni Kurukshetra, HR

Computer Engineering Diploma

Computer Engineering

Jun 2016 - May 2018

Govt Model Sanskriti Senior Secondary School, Ismailabad Kurukshetra, HR

Senior Secondary

Apr 2013 - Mar 2014

Govt Model Sanskriti Senior Secondary School, Ismailabad Kurukshetra, HR

Secondary

Apr 2011 - Mar 2012

Licenses & Certifications

Google Cloud Certified – Professional Data Engineer

Google

Issued: Mar 2025• No expiration

Skills

Python
SQL
Bootstrap
HTML
CSS
Django
Flask
FastAPI
DBT
Git
Docker
VS Code
Visual Studio
PyCharm
pandas
NumPy
Ubuntu
CentOS
Microsoft Windows Server
MySQL
PostgreSQL
MongoDB
BigQuery
Snowflake
AWS Glue
AWS Lambda
AWS S3
AWS VPC
AWS EC2
AWS CloudFront
AWS CloudWatch
AWS IAM
AWS Load Balancer
GCP Cloud Function
GCP Cloud Run
GCP IAM
GCP Firestore
GCP Cloud Build
GCP Dataflow
GCP Pub/Sub
Azure Function App
Azure PostgreSQL
Azure Storage
ETL/ELT Pipelines
Data Warehousing
Real-time Streaming
Data Modeling
Data Integrity & Monitoring
Transformation Workflows
SnapLogic