Mansi Gupta

Designed and developed scalable data pipelines using Apache Spark to process a large volume of data on a daily basis, incorporating both incremental and full refresh strategies to update the data lake. Developed a versatile script for seamless ingestion of data from various APIs into the data lake, enhancing data accessibility and integration capabilities. Utilized PySpark to develop denormalized tables of EIP 4.0 modules on a document level, enabling streamlined reporting and analysis of data. Spearheaded the development of a robust On-premise BigData lake architecture using HDFS and Apache Spark, orchestrating a multi-node cluster for efficient data ingestion and processing operations. Played a pivotal role in creating essential APIs and stored procedures for the Asset Management System module of EIP 4.0, enabling seamless integration and efficient management of assets. Developed critical APIs for the Logsheet mobile application, facilitating the seamless capture and retrieval of asset details for enhanced efficiency in asset management.

Designed and implemented an agile methodology framework in Excel, streamlining project management processes and enhancing team collaboration and productivity. Acquired proficiency in MSBI tools and successfully implemented them in projects, leveraging their capabilities for efficient data integration, analysis, and reporting.