Default profile banner
AK

Avinash Kumar

@avinashkumar2622

Data Engineer at Larsen & Toubro Infotech

Bangalore

https://www.linkedin.com/in/avinash-kumar-854a6b115

Larsen & Toubro Infotech

Avinash is an IT professional with over 5 years of experience, specializing in Microsoft Azure Cloud Computing. His expertise includes migrating SQL databases to Azure Data Lake and developing Spark applications using Spark-SQL for complex data transformation and insight generation. He is proficient in various Azure services (ADF, Data Lake, SQL DW) and has experience delivering BI reporting solutions using Power BI and SSRS.

Experience

Data Engineer

Larsen & Toubro Infotech

Mar 2021 - PresentBangalore

Analyze, design, and build Modern data solutions using Azure PaaS service to support visualization of data. Understand current Production state of application and determine the impact of new implementation on existing business processes. Extract Transform and Load data from sources systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics. Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks. Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform, and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards. Developed Spark applications using Pyspark and Spark-SQL for data extraction, transformation, and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns. Responsible for estimating the cluster size, monitoring, and troubleshooting of the Spark databricks cluster. Experienced in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning. To meet specific business requirements wrote UDF’s in Scala and Pyspark. Developed JSON Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the data using the SQL Activity.

Support Engineer

Bureau Veritas Consumer Product Services

Jul 2018 - Jan 2021Noida

Building, configuring, patching, upgrading, and troubleshooting of physical and virtual Windows/Linux servers (rack mounts/blades, and VMs). Taking care of backup, off-site tape storage, inventory-asset management. Investigating, resolving, and closing user reported PC problems and application issues through our ticketing system. Monitor server event logs, performance logs, growth of data on the network, and checking the status of nightly server backups. Creating, Deleting, and managing all objects of Active Directory by using GUI as well as by CMD. Objects like: OU, Users, Groups, Computers, Shared files, and Printers. Supporting all the applications, Hardware, and Network issues. Basic understanding of Network security concepts such as NAT, VPN, IPSEC and Firewalls.

Support Engineer

HCL Infosystem LTD

Jan 2017 - Feb 2018Bangalore

Installation, Configuration and troubleshooting of Windows XP, Vista, Windows7, windows 8, windows 8.1, windows 10. Troubleshooting of hardware, OS & peripheral related problems. Installation and administration of Email Server, Clients- SMTP, POP, IMAP, send mail. Installation and configuration of printers. Creating file system & troubleshooting file system problems. Installation, maintenance and troubleshooting of various Microsoft products such as Windows servers, clients, and office 365 products. Configuring MS Outlook. Resolve the functional and technical errors, provide update patches to the clients on P2P application, establish remote desktop connection to install and update business applications. Also handling Symantec Antivirus Endpoint Protection Server Monitoring. Troubleshoot technical issues and identify modifications needed in existing applications to meet changing requirements. Analyzing activity log files and diagnosing Application Server problems.

Education

B. Tech

Telecommunication

Jan 2016Grade: First Class

Licenses & Certifications

Oracle Cloud Infrastructure 2019 Certified Associate Architect

Credly

• No expiration
View Credential

Oracle Cloud Infrastructure 2019 Certified Professional Architect

Credly

• No expiration
View Credential

Microsoft Certified: Azure Administrator Associate

Credly

• No expiration
View Credential

Skills

Azure Cloud Computing
AWS
Oracle
Microsoft Azure
Azure Databricks
Azure SQL Database
Azure SQL Datawarehouse
SQL
T-SQL
Python
PySpark
Spark SQL
Scala
Apache Spark
Azure Data Factory (ADF)
Data Lake Analytics
Data Migration
Power BI
SSRS
Grafana
Linux
Windows
Active Directory
DevOps
ETL