Devansh Swami
@devansh
Data Engineer at Ark Infosoft
Ahmedabad, Gujarat, India
I am a Data Engineer with hands on experience with building streaming and batch pipelines with tools like Kafka, AWS Glue, Redshift, and PySpark. I also have exposure to other cloud services like GCP and it’s AWS equivalents. I enjoy making systems faster, more stable, and easier to manage and keep my focus on making pipelines that are scalable and reliable.
Experience
Data Engineer
Ark Infosoft
Built a real time streaming pipeline using Apache Kafka, AWS Glue, and AWS S3 to process streaming data under 10 seconds latency. Used PySpark for transformations and automated partitioning for scalable analytics. Achieved reliable ingestion of 50k+ events/hour. Built an end to end CI/CD pipeline using GitHub Actions, Docker, and Google Compute Engine to automate build, test, and deploy stages for a Flask app. Reduced deployment time by ~25% and improved release stability using caching, rollback workflows, and zero downtime deployments. Added monitoring and structured logs to track each deployment step, making it easier to debug issues that might come up.
Data Engineer Intern
F13 Technologies
Designed modular DAGs connecting S3 to Lambda to Redshift. Implemented S3KeySensorAsync, retries, and XCom based metadata passing to ensure fault tolerant execution. Optimized DAG performance, reducing task runtime by 30% for large scale ETL workloads.
Education
ITM SLS Baroda University
Bachelor of Technology
CSE
St. Stephens High School
Class XII
Class X: 86.42%
Licenses & Certifications
AWS Certified Data Engineer - Associate (DEA - C01)
AWS