Default profile banner
NR

Niramay Roy

@niramayroy

Member of Technical Staff at Datametica Solutions Pvt. Ltd.

Pune, India

www.linkedin.com/in/royniramay

Datametica Solutions Pvt. Ltd.Dr D.Y Patil College of Engineering

Niramay Roy is an experienced data engineer skilled in building robust data frameworks using Python and Django. He has a proven track record in complex ETL tasks, including migrating data from Oracle to Google Cloud Platform (GCP) using Informatica. His expertise spans data warehousing, utilizing tools like DataStage and Airflow, and ensuring data integrity across various systems.

Experience

Assurance Framework - Member of Techinal Staff

Datametica Solutions Pvt. Ltd.

Jun 2023 - PresentPune, India

Designed and developed a robust framework using Python and Django, enabling seamless integration and management of various components within the project. Spearheaded the implementation of a custom rule engine using python, leveraging Django’s extensible architecture, to automate the analysis of source and target files. Engineered automated processes to extract, process, and compare data between source and target files, significantly reducing manual intervention and increasing efficiency by 40 Percent. Created a robust Django-based framework that streamlines the integration and management of diverse project components, successfully reducing manual effort by 40 percent.

Engineer 1

Mattel

Jan 2023 - Jun 2023

Successfully led the migration effort from Oracle to Google Cloud Platform (GCP) utilizing Informatica ETL tool, ensuring seamless and secure data transfer. Utilized Informatica’s advanced features, including data masking, data validation, and error handling to guarantee the accuracy and integrity of migrated data during the transfer process. Conducted thorough testing and validation of data integrity post-migration, performing reconciliation checks to verify that data in GCP accurately mirrored the source data in Oracle. Orchestrated a seamless migration from Oracle to GCP, utilizing Informatica ETL tools. Ensured data accuracy and integrity through advanced features and meticulous testing.

Associate Engineer 1

Academy Sports + Outdoors (ASO)

Sep 2021 - Dec 2022

Collaborated on ETL tasks, ensuring data integrity and validating pipeline stability. Translated DataStage’s Master Sequences and Parallel jobs for the implementation of data loading and transformation into BigQuery. Engineered intricate mappings, maplets, and workflows to address business requirements, emphasizing reusability to optimize efficiency and minimize duplication. Designed and executed sophisticated data mappings, orchestrating data movement from multiple origins into a unified target table within the data warehouse. Employed methodologies such as lookups, transformations, merge operations, CDC (change data capture), joins, and funneling in DataStage environments. Expertly applied Slowly Changing Dimension (SCD) techniques within insurance applications. Utilized various tools, including UC4 and Airflow Dags, for effective scheduling and monitoring of processes.

Education

Dr D.Y Patil College of Engineering

Bachelor of Engineering

Computer Engineering

Aug 2016 - Jun 2020

Licenses & Certifications

Google Cloud Certified Associate Cloud Engineer

Google Cloud

• No expiration

Apache Airflow Fundamentals

Astronomer

• No expiration

Skills

SQL
Python
Shell Scripting
Django
REST APIs
Airflow
GitHub
Docker
DataStage
Informatica
ETL Tools
BigQuery
Composer
Cloud Storage
PostgreSQL
Netezza
Oracle
Communication
Collaboration
Adaptability