Suhas Chougule
@suhaschougule
Data Engineer (Bigdata Developer)
Pune, Maharashtra
Suhas has over 5 years of experience in the Information and Technology Industry, including 2+ years as a Bigdata Developer. He possesses strong expertise in designing and implementing big data applications using Apache Spark, Hadoop, and AWS cloud technologies. Proficient in Scala and Python, he has extensive experience with various data ecosystems, including Spark SQL, Hive, and working with structured and unstructured datasets.
Experience
Data Engineer
Fiserv India Pvt. Ltd
Understanding customer business requirement and preparation of mapping by analyzing data flow and evaluating transformation and data fixes. Worked on development, enhancement and supporting in data ingestion, data migration. Processed large amount of data using spark-sql. Data processing using Python and Spark (Pyspark). Data Ingestion in Hadoop Data Lake. Data validation using Quality check. Automation using Airflow. Job execution monitoring, debug, bug fixing. Job automation using shell scripting and oozie. Work with onshore and offshore team.
Data Engineer
Understand the upstream source nature and work with business cases. Written sqoop jobs to extract records from downstream source. Work closely with the business and analytics team in gathering the system requirements. Export and Import batch data and delta into HDFS, HBase and Hive using Sqoop. Involve in creating Hive tables, loading with data and writing Hive queries. Analyzed Data in data warehouse. Reconcile the imported or transformed data as per business requirement. Written various Shell Scripts and Powershell Scripts to automate the process.
Support Engineer/Analyst
Vodafone
L2 Level Support. Communicating with users/customers and solving their queries with SLA. Writing automation scripts/stored procedures for streamlining the processes. Scheduling and managing Cron-jobs. Reporting data verification after necessary analysis on different revenue streams. Testing and Implementation of new CRs. Load balancing of data on various UNIX servers. Interacting with other system owner teams, different support groups in case of any problem or activity planning. Analyzing of High CPU loads, Tablespace Usage, Critical Table Growths and Alert logs of Unix Server and database on daily basis. Troubleshooting various Database and Application-Level issues. Addressing revenue leakages. Solving the severity Incidents within the SLA. Resolve data duplication, updating reference tables and resolving day to day activity faced by end user. Providing Training to new joiners to improve their technical and functional skills. Assigning various shift tasks to juniors and carrying out them in disciplined manner.
Support Analyst
Vodafone
L1 Level Support. Use assurance of different revenue streams and trend monitoring. Subscriber reconciliation assurance using switch/billing/CRM system feeds and ensure subscriber profile synchronization. Taking care of all other daily routine tasks like creating users, roles, tablespace, addressing alerts triggered from monitoring tools etc. Running of usage rules to find the revenue leakage. Calculating various KPIs. Monitoring the CPU usage, IO statistics, and CPU time to identify any OS level Performance killers. Taking care of all other daily routine tasks like creating users, roles, tablespace, addressing alerts triggered from monitoring tools etc. Loading huge data into the CUBE using sql server 2008. Solving the severity Incidents within the SLA.
Education
University of Pune
MCA