Sushant Malhotra
@sushant.malhotra
Programmer Analyst at Cognizant Technology Solutions
Jaipur, India
Results-driven Data Engineer with over 2.7 years of experience specializing in PySpark, Azure Databricks, Azure Data Factory. Proven expertise in ETL, data manipulation, insights mining, data modeling, data migration and managing data pipeline.
Experience
Programmer Analyst
Cognizant Technology Solutions
Analyzing existing Teradata BTEQ scripts to understand logic and data flow. Developing Databricks notebooks using PySpark and Spark SQL. Collaborating with the team to design and implement efficient data pipelines using Azure Data Factory. Conducting Performance Optimization of Spark jobs using Broadcast joins, Repartition and coalesce.
Data Engineer
Sigmoid Analytics
Designed and implemented a data pipeline handling both structured and unstructured data using Azure Databricks, Azure Blob Storage, and Delta Lake. Automated data ingestion via event-based triggers. Processed structured and unstructured data using PySpark. Performed data cleaning and transformation. Stored processed data in Delta Lake. Ensured security using Azure Key Vault and RBAC.
Education
Poornima College of Engineering (PCE), Jaipur
Bachelor of Technology
Electronics and Communication Engineering