Anjali Tripathi

Developing an application to efficiently process on-demand requests from an SQS queue by reading data from DeltaLake in delta format dataframes. Leveraging Spark SQL for seamless querying of data, followed by storing the output in an S3 bucket for further processing. Developed a critical application for a data pipeline for fetching data from a partitioned S3 bucket using Apache Spark using different spark-based principles like predicate/projection pushdown to load only the necessary data and dump it in the database. Overseeing 19 applications for GAPZAP, a popular geolocated TV listings website in the USA and Canada, generating 4 million daily hits. Proven expertise in delivering customized solutions to paying clients and providing swift support for production-level issues. Refactored and deployed the entire backend which is a suite of 6 applications from .NetFramework4.7 to .Net6 without any downtime on the website. Created a chatbot capable of starting and stopping EC2 and RDS instances of particular environment with simple messaging from slack using AWS. Created a Lambda which queries the S3 logs using Athena and posts the count of 5XX errors faced by the users of the website on slack daily morning for better monitoring of the performance of the website.

Developed a highly configurable tool as a part of Fallout Management Solution for performing view and update operations on entity in the form of a multilayered large JSON. Created a user-friendly tool for API log visualization in a tree format and for comparing different log files in the form of JSON and XML. Worked on data scrapping from HTML pages using BeautifulSoup to get relational and logical data from Data Models. Built a generic Background Task module using multithreading for resolving the problem of server blockage while running long tasks. Built a generic library in python for supporting DDL and DML operations on Oracle and Postgres. Managed a group of 10 interns who were working on refactoring a dashboard.

Improved performance of various data migration tools with JS/HTML in frontend and Python/PHP in the backend. Created a tool for data lineage and traceability for data migration from source to target at both column and table level also supporting values. Created various API based services for JSON handling and operations.