Avanish Gupta

Handling E2E cycle of scraping, cost estimation and delivery. Writing internal team libraries for logging, AWS, Google Services, file I/O, parsers and alerts to speed up the ramp up process of a scraper by a factor of 6. Creating data pipelines for data obtained by scraping the websites and applications. Improving Developer Productivity by designing and developing internal tools and services such as a NDJSON file viewer and a local file server. Writing 10+ Scrapers and Crawlers for client competitor websites and mobile applications(Android). Developing the uniform code structure of the monorepo to help fast context switches across the teams.

Implementation of complex business logic of a Crypto Mutual Fund with improvement in a provided design. Executing batch of transactions on an hourly basis. Development of 25+ REST APIs, scheduler services with documentation in Swagger and Postman. Design and development of complaint management module using Amazon S3 for storage and MongoDB for data. E2E Implementation of the mailer using Mailgun Template API. Created an internal mailing system using AWS SES and HTML templates to reduce the cost by factor of 20. Handled the test deployment on AWS EC2 and managed databases including MySQL and MongoDB.

Worked closely with IDBMS team to analyze the sales data of 1M+ records. Upgraded part of codebase from flair to PySpark for NLP to speed up the NER by 10 times.