NITISH MALIK

Worked on live projects related to TP’s internal services and products which includes call centre data with surveys and sentiments data and making tables out of it over cloud. Gained knowledge in the global team to control 3 servers at a time while ensuring the data integrity and data privacy. Worked on shifting the data from on premises to Azure Cloud using Synapse and writing code in synapse notebooks using combination of Pyspark and spark SQL and acted as intermediate to make sure the process is running on daily basis. Testing and checking data quality before final data load is also ensured to create a smoother work flow. Customizing the pipeline load according to the need to prevent data duplicate in final dumping of data in delta tables. Shifted the whole Mytp to cloud while creating its pipeline, creating delta tables out of raw data and its stored procedure and delivered it to Power BI team for reporting. Automated the shifting process using triggers and monitor data flow using Azure Synapse Pipelines. Used certain date columns as filters and parquet file type to tune the daily data load and increase productivity. Query and delta table optimization for faster results is also implemented for cost management. Created the Delta tables based on all 3 servers using Pyspark and spark SQL code on Azure cloud and maintain the CCMS DB with checking the data count and random value checks. ETL and modifications over TpSurvey for Power BI team based on feedbacks and comments in TP calling processes to ensure the desired goal of reporting is matched. Worked over HCRM people’s dashboard related to Brazil and created its delta tables for matrix calculations. Took the leadership and control access over views based on geographical regions and employee’s access tier. Created tables, views and stored Procedures using SQL in ICIMS to fulfil the requestor’s demand. Data validation across all the servers to meet global data team criteria to make sure regional team is not lagging i