DARREN THOMAS

Data Reconciliation project focuses on reconciling data between various transaction monitoring systems live in the Bank. Reconciliation reports are generated to identify any breaches and are displayed in the dashboard. Successfully built new recon systems for new Transaction Monitoring Systems and enhanced existing data reconciliations as per requirements. Migrated the code form Hive to Beeline. Developed automated Shell Scripts to run Hive queries.

Data Quality Measurement checks for the quality of data inside Bank based on many parameters. It runs monthly batches and generates monthly report. Data consistency compares Critical data elements between various systems. Built Data Consistency code as a sub branch and integrated it with the existing Data Quality Measurements. Worked on code migration from Hive to Spark. Developed automated Shell and python scripts to run Hive queries.