Default profile banner
NS

Neeraj Kumar Singh

@neerajkumarsingh

Senior Data Engineer at msg global Solutions India Private Limited

Bengaluru

msg global Solutions India Private LimitedShri Mata Vaishno Devi University

Senior Data Engineer with 6 years of experience designing, implementing, and maintaining data solutions on the AWS platform. Skilled at tackling challenging architectural and scalability problems, and collaborating in team environments. The candidate continuously learns to optimize data workflows and drive business insights.

Experience

Senior Data Engineer

msg global Solutions India Private Limited

Private Limited•Aug 2023 - Present•Bengaluru

Developed and optimized data models using Gremlin-python and Amazon Neptune DB. Architected and implemented automated reporting pipelines on AWS using Terraform for Infrastructure as Code (IaC). Leveraged AWS services including Batch Jobs, ECR, S3, Glue Crawler, DynamoDB, Cognito, and Neptune DB to streamline data ingestion and processing workflows. Managed fine-grained access control and permissions using AWS IAM and Lake Formation.

Senior Consultant

EXL Services (Inductis India Pvt Ltd)

Consulting•May 2023 - Aug 2023•Bengaluru

Partnered with clients to understand business requirements and delivered tailored solutions for user data using AWS Cognito for secure authentication and DynamoDB for scalable data storage.

Data Engineer

Stats Perform

Full-time•Mar 2020 - May 2023•Bengaluru

Designed and developed scalable, reusable, event-driven data pipelines to ingest sports data from multiple sources. Stored and managed processed and raw sports data in AWS Data Lake (S3), DynamoDB (NoSQL), and Redshift (DWH), while streaming real-time data using Kinesis Data Streams and MSK (Kafka). Utilized a broad range of AWS services, including Lambda, SNS, SQS, Kinesis, S3, CloudWatch, API Gateway, DynamoDB, AppSync, MSK (Kafka), Athena, Redshift, and Glue.

Senior Software Engineer

Saggezza - an Apexon Company

Consulting•Apr 2019 - Mar 2020•Bengaluru

Developed event-driven data pipelines to ingest financial data from multiple sources. Stored processed and validated data in AWS S3 for scalable storage and DynamoDB for low-latency access. Utilized C# and Python for advanced data transformation.

Software Developer

Tradelab Technologies

Full-time•Dec 2014 - Mar 2019•Bengaluru

Independently managed the entire product lifecycle for the Stock Trading Dealer Application for OMS. Integrated WebSocket APIs and REST APIs across multiple application modules. Developed new features and performed bug fixes for technical charts in Zerodha Pi.

Education

Shri Mata Vaishno Devi University

B Tech

Licenses & Certifications

AWS Certified Data Engineer

AWS

• No expiration

Credential ID: 8c4f7d7b4cbf4530b4f6e12c6d6766b1

AWS Certified Database Speciality

AWS

• No expiration

Credential ID: 932b6e09f0d1433c98f9861e26d9cf4b

AWS Certified Solutions Architect - Associate

AWS

• No expiration

Credential ID: FF23P3DLM111135X

AWS Certified Developer - Associate

AWS

• No expiration

Credential ID: PS60JZV1S24QQYW0

AWS Certified AI Practitioner

AWS

• No expiration

Credential ID: 606e75ecb0794b5ca4ee4ed9da7072fb

AWS Certified Cloud Practitioner

AWS

• No expiration

Credential ID: 0MC3NYJDJME41YKG

Terraform Associate

HashiCorp

• No expiration

Credential ID: 003

Skills

Data Engineering
AWS
Python
Pandas
SQL
Kafka
Terraform (IaC)
CICD
OOPS
C#
GitHub
Bitbucket
Jenkins
Confluence
JIRA
Gremlin-python
Amazon Neptune DB
Power BI
CloudWatch
CloudTrail
DynamoDB
S3
Glue Crawler
Cognito
Redshift
Kinesis Data Streams
API Gateway