Shubham Singh is an experienced Data Engineer skilled in building robust data pipelines and performing complex data transformations. He possesses strong expertise in AWS services, including Lambda, Glue, and DMS, and is proficient in ETL tools like Ab-Initio. Furthermore, he has sound knowledge of SQL, Python, PySpark, and Unix/Shell Scripting for data manipulation and system automation.
Experience
Data/Cloud Engineer
Blazeclan Technologies
AWS Lambdas (using python) for code exectuion and scheduling within Step functions using AWS cloudwatch. S3 and RDS for Storage. AWS Glue for discover, prepare, and combine data for analytics, machine learning, and application development using python pandas and numpy. AWS DMS for migration of data. Hands on Data-Lake on AWS services with like S3, Data Pipeline, EC2, Cloud9, Lambda, Redshift, Glue, Athena. Sound scripting knowledge like UNIX/LINUX Shell Script and writing SQL queries. Strong background in Data Engineering, Database Migration, Data Modeling.
ETL Developer
Atos-Syntel
Mainly involved in building Ab Initio graphs as per the client requirement, shell scripting and data analysis. Pyspark SQL Module (Loading data from oracle in form of parquet using Sqoop and loading into Hive Database. Sound scripting knowledge like UNIX/LINUX Shell Script and writing SQL queries. Having strong analytical skills and quick in providing the permanent solutions files, Multi files,database tables, etc.
Education
Center for Development of Advance Computing
Post Graduate Diploma in Advance Computing
Technocrats Institute of Technology
Bachelor of Engineering