Shubham Bajpai
@Shubham_Bajpai
Data Engineer at Albiorix Technology
Ahmedabad, Gujarat, India
Shubham Bajpai is a Data Engineer with nearly four years of experience in architecting cloud-native data platforms on AWS and Azure. He specializes in high-throughput ETL/ELT pipelines, big data processing using Spark and PySpark, and serverless architectures. Shubham has a proven track record of optimizing data workflows, implementing RAG-based LLM solutions, and migrating on-prem systems to the cloud. He holds a Master of Computer Applications and is proficient in Python, SQL, and various big data technologies.
Experience
Data Engineer
Albiorix Technology
Architected and optimized scalable ETL pipelines on Azure Cloud using PySpark, NumPy, and Pandas within Azure Databricks. Designed and orchestrated event-driven data workflows leveraging Azure Data Lake Storage (ADLS), Azure Functions, Azure Event Grid, and Azure API Management. Designing an LLM-powered chatbot using LangChain to orchestrate prompt pipelines.
Data Engineer
Exponentia.ai
Architected and deployed a scalable AWS-based ETL pipeline processing 10M+ records daily. Led on-prem to AWS migration, automating Python workflows on SageMaker. Built scalable end-to-end analytics platform for HDFC Life Insurance. Architected a serverless microservices solution using FastAPI, integrating PostgreSQL, MongoDB, and Snowflake.
Software Engineer
Cedcoss Technologies Pvt. Ltd.
Engineered a high-throughput, event-driven data pipeline leveraging AWS serverless stack (API Gateway, Lambda, SQS, DynamoDB), processing 100K+ webhook events daily. Automated Shopify data synchronization workflows. Developed scalable REST and GraphQL integrations with e-commerce platforms.
Education
Dr. A.P.J. Abdul Kalam Technical University, Lucknow
Masters of Computer Applications
Computer Applications
Chhatrapati Shahu Ji Maharaj University, Kanpur
PGDCA
Computer Applications
Chhatrapati Shahu Ji Maharaj University, Kanpur
Bachelor of Science
Science