Default profile banner
SC

Suhas Chougule

@suhaschougule

Data Engineer (Bigdata Developer)

Pune, Maharashtra

www.linkedin.com/in/suhas-chougule

Fiserv India Pvt. LtdUniversity of Pune

Suhas has over 5 years of experience in the Information and Technology Industry, including 2+ years as a Bigdata Developer. He possesses strong expertise in designing and implementing big data applications using Apache Spark, Hadoop, and AWS cloud technologies. Proficient in Scala and Python, he has extensive experience with various data ecosystems, including Spark SQL, Hive, and working with structured and unstructured datasets.

Experience

Data Engineer

Fiserv India Pvt. Ltd

Project•Oct 2021 - Present

Understanding customer business requirement and preparation of mapping by analyzing data flow and evaluating transformation and data fixes. Worked on development, enhancement and supporting in data ingestion, data migration. Processed large amount of data using spark-sql. Data processing using Python and Spark (Pyspark). Data Ingestion in Hadoop Data Lake. Data validation using Quality check. Automation using Airflow. Job execution monitoring, debug, bug fixing. Job automation using shell scripting and oozie. Work with onshore and offshore team.

Data Engineer

Project•May 2020 - Oct 2021

Understand the upstream source nature and work with business cases. Written sqoop jobs to extract records from downstream source. Work closely with the business and analytics team in gathering the system requirements. Export and Import batch data and delta into HDFS, HBase and Hive using Sqoop. Involve in creating Hive tables, loading with data and writing Hive queries. Analyzed Data in data warehouse. Reconcile the imported or transformed data as per business requirement. Written various Shell Scripts and Powershell Scripts to automate the process.

Support Engineer/Analyst

Vodafone

Project•Dec 2016 - May 2020

L2 Level Support. Communicating with users/customers and solving their queries with SLA. Writing automation scripts/stored procedures for streamlining the processes. Scheduling and managing Cron-jobs. Reporting data verification after necessary analysis on different revenue streams. Testing and Implementation of new CRs. Load balancing of data on various UNIX servers. Interacting with other system owner teams, different support groups in case of any problem or activity planning. Analyzing of High CPU loads, Tablespace Usage, Critical Table Growths and Alert logs of Unix Server and database on daily basis. Troubleshooting various Database and Application-Level issues. Addressing revenue leakages. Solving the severity Incidents within the SLA. Resolve data duplication, updating reference tables and resolving day to day activity faced by end user. Providing Training to new joiners to improve their technical and functional skills. Assigning various shift tasks to juniors and carrying out them in disciplined manner.

Support Analyst

Vodafone

Project•Apr 2015 - Dec 2016

L1 Level Support. Use assurance of different revenue streams and trend monitoring. Subscriber reconciliation assurance using switch/billing/CRM system feeds and ensure subscriber profile synchronization. Taking care of all other daily routine tasks like creating users, roles, tablespace, addressing alerts triggered from monitoring tools etc. Running of usage rules to find the revenue leakage. Calculating various KPIs. Monitoring the CPU usage, IO statistics, and CPU time to identify any OS level Performance killers. Taking care of all other daily routine tasks like creating users, roles, tablespace, addressing alerts triggered from monitoring tools etc. Loading huge data into the CUBE using sql server 2008. Solving the severity Incidents within the SLA.

Education

University of Pune

MCA

Jan 2015•Grade: 63.52%

Skills

Bigdata Developer
Apache Spark
Hadoop
AWS
Spark SQL
Spark streaming
Scala
Python
SQL
Airflow
Pyspark
Hive
HBase
Shell Script
Sqoop
MapReduce
EC2
S3
EMR
Redshift
Athena
Oracle
MySQL
Postgre
ETL
Data Ingestion
Data Migration