Hemanta Sahu

Designed and implemented a real-time data pipeline using modern technologies such as Airbyte and DBT to ingest semi-structured data in an incremental order daily. Built an architecture for implementing a new, cost-effective data pipeline alongside an existing one. Utilized Data Build Tool (DBT) to convert data into human-readable format, and ingested data from disparate sources using Python and ETL tools to store in a destination. Communicated with managers and analytics team to upscale the business and reduce infrastructure costs through effective data pipelines while managing large datasets without losing any data. Developed an API with OpenAPI to access filter data from the ETL pipeline, using this data to create dashboards for business purposes.

Worked independently to design, develop, and test code. Collaborated closely with the team to create story points and sprint planning. Applied change control best practices for software enhancements to minimize end-user disruptions. Worked with the R&D team to look for the best solution to speed up the scraping process. Reversed engineered web technologies to provide organized data. Supervised the work of programmers, and designers, assigned tasks, and monitor performance against targets. Projects included a Python package for web scraping (Crawler) and a tool to track and analyze website traffic (Website Traffic Monitor).

Designed and developed forward-thinking systems that meet user needs and improve productivity. Authored code fixes and enhancements for inclusion in future code releases and patches. Coordinated project tasks among multiple departments. Sat in on design team and planning meetings. Prioritized tasks and completed them in order of importance. Projects included InterviewBot (a web application for real-time interview generation) and Quantumzyme (a web application providing enzyme information for the biotechnology industry).