Default profile banner
MM

MOHAMMAD MUQTHAR

@mohammadmuqthar

Big Data Developer

Kasaragod, Kerala

TCS (Client: Nordea)

Mohammad Muqthar is a Big Data Developer with two years of experience in the Hadoop ecosystem. He possesses strong technical skills in technologies such as Apache Spark, Hive, Kafka, and Sqoop, complemented by proficiency in Python, Scala, and SQL. He has experience in developing data models, managing data ingestion pipelines, and working within Agile methodologies to meet stakeholder requirements.

Experience

Big data engineer

TCS (Client: Nordea)

•Apr 2021 - Present•Kasaragod, Kerala

Involved in creating hive tables, loading data into HDFs from external data source and analyzing the data using hive queries. Writing spark sql for the required input data and performed data transformations. Design and develop Data models and performed Data quality checks using Hive queries. Developed CDC logics for certain requirements needed for some deliveries. Creating Pyspark multithreading scripts for transforming and ingesting large data sets from source to target hive tables. Designing and scheduling workflow and coordinator jobs in Oozie. Unix shell scripting for file generation and for auto deployment package. Worked on data quality checks and monitoring. Developed test cases as per requirements and supports for the testing. Gathers requirements from business analysts.

Skills

SQL
Python
Scala
Unix Shell Scripting
Hadoop
Hive
Kafka
Oozie
Apache Spark
HDFS
Sqoop
Pyspark
Agile Methodology