Manoj Ughade

Creating and maintaining data pipelines. Ingesting data from RDBMS to HDFS. Ingesting data from the client server to HDFS, which involved extracting ZIP files to obtain TSV files, cleaning those TSV files, and loading them into HIVE tables. Performing validations on imported data and merging it with existing data. Analysing geospatial data using Hive and Spark. Generating report data for various use cases, such as car maintenance timings, fuel efficiency, detecting rash driving and customer satisfaction analysis, to benefit the organization. Working with the DEV team to create a custom web UI for displaying interactive reports. Utilizing shell scripts to automate the entire process.