Akshay Agnihotri
@akshayagnihotri
Senior Data Engineer
Bengaluru, India
Akshay Agnihotri is a Senior Data Engineer with over 11 years of experience in the banking and retail sectors. He specializes in designing, developing, and delivering data warehouse solutions using both traditional and Big Data methodologies. His expertise includes ETL/ELT architecture, Hadoop ecosystems (Hive, Spark, PySpark), and proficiency with tools like DataStage, ensuring robust data pipelines across the full software development lifecycle.
Experience
Senior Software Engineer
Danske IT and Support Services
Architecture, Design, Development of Customer attributes data pipeline which sourced from multiple system and delivered denormalized data for AML system by using PYSPARK. Designed and developed website cookies data extracts using Python and BigData technologies to transfer the data from Hadoop to SQL server by performing some aggregation. Design and development of Anonymization program. Built generic framework. Key contributor to Row Level Security project in Danske Bank.
Senior Software Engineer
Limited Brands
Involved in design and development of new objects using Datawarehouse tools such as DataStage, Teradata, Hive and Oracle DB. Design and development of DC6 project (Distribution Center) data pipeline from Data Ingestion till presentation layer loads. (Includes writing Hive, Spark, and Teradata Scripts). Worked on Localytics project (IOS, Android events data) to make the data available in MAPR. Participated and worked on complete Agile (Scrum) software development Lifecycle tasks (requirement, design, coding, testing and documentation). Led and coached operations support team for EDW and Bigdata technologies. Numerous improvements done to fix long running jobs and apply fixes for frequently failing production jobs. Design and implementation of innovative solutions for brands like Victoria’s Secret, PINK and Bath and Body Works using right mix of best practices and methodologies. Worked on Big data technologies and Teradata to enable and integrate operational reporting for Distribution Centers (DC). Introduced quality review process through peer review, checklists, coding standards, etc. Led and mentored the other developers with various technical issues.
Senior Software Engineer
Tesco Bank
Development of various projects in Tesco Bank such as Insurance, Credit Card and Savings programs. Key member in NFT (Non-Functional Testing) and Dress Rehearsal activities for key programs in Tesco Bank. Prepared Unit test case documents, Low Level Design documents. Involved production batch stability (FRMIT batch) project to optimize long running jobs and provided innovative ideas which had led to significant decrease in batch run time. (From 15 hours to 8 Hours). Eventually this was recognized by management. Supporting Integration/UAT testing and Defect fixing.
Education
Visvesvaraya Technological University
Bachelor of Engineering
Computer Science and Engineering