Shivang Katiyar

Designed and implemented middleware platform integrations for distributed enterprise systems, enabling seamless data exchange across services and partners while maintaining 99.9% uptime through centralized orchestration. Engineered asynchronous messaging queue operations with robust error handling and message replay, processing 10,000+ messages daily with high reliability across dynamic message broker ecosystems. Optimized ETL workflows and B2B integrations using Seeburger and Informatica, improving data processing efficiency by 25% and reducing pipeline latency through performance tuning. Implemented API gateway monitoring, diagnostics, and Splunk-based log aggregation for real-time observability and root cause analysis, reducing incident resolution time by 40% and improving system scalability and fault tolerance.

Built scalable data pipelines processing 50+ TB of data daily for millions of users, ensuring high throughput, data integrity, and reducing SLA breaches by 35% through proactive monitoring and Jira issue management. Led migration of multi-product data workflows from Oozie to Azkaban, minimizing orchestration errors by 30% and improving deployment efficiency across 15+ production pipelines. Optimized legacy Pig/Hive jobs by rewriting into Apache Spark transformations, achieving up to 4x faster execution in production environments. Developed internal React.js + Node.js portal that automated team workflows and improved reporting efficiency by 50%, alongside enhancing unit testing coverage across Java and Scala-based distributed systems.