Dirgh kushawaha

Develop a data platform from scratch and took part in the requirement gathering and analysis phase of the project in documenting the business requirements. Worked in designing tables in Hive, MYSQL using SQOOP and processing data like importing and exporting databases to the HDFS, involved in processing large datasets of different forms including structured, semi-structured, and unstructured data. Worked with Hadoop architecture and the daemons of Hadoop including Name-Node, Data Node, Job Tracker, Task Tracker, and Resource Manager. Used data pipeline for Data Extraction, Transformation, and Loading from homogeneous or heterogeneous data sources. Developed scripts to load data and was involved in ingesting data into the Data Warehouse using various data loading techniques. Build queries for performing various CRUD operations like create, update, read and delete. Using Ab Initio tool for data processing. Leveraged knowledge in SQL, Hadoop, Data Modeling, Ab Initio.

The project was to interpret data to conclude action and strategy. Build the Data Models to generate meaningful insights. Build out the data and reporting infrastructure from the ground using PowerBI and SQL to provide real-time insights into the product. Assisted senior-level data scientists in the design of ETL processes. Created coherent Logical data models that helped guide important client business decisions. Leveraged knowledge in ETL, SnowFlake, SQL, DAX functions, PowerBI.