SURAJ GUPTA

Building proof of concepts within the organisations technical frameworks / expansions to solve business problems. Designed & lead the development of AWS sdk based Datasync utility services for cloud migration. Working closely with Product owners & salesforce partners (AWS) to fulfil the business deliverables.

Leading the development work on Migration of outgoing Teradata system into datalake. Building Streaming application pipelines using Spakr+Kafka integration framework. Working on understanding and streamlining Walmart existing processes for better coordination and alignment among teams. Leading the efforts in migration of existing traditional internal ETL framework and scheduling tools to advanced processing framework like Spark along with building CICD pipelines.

Worked in a fast-paced agile development environment to quickly analyze, develop, and test potential use cases for the business. Work closely together with global tech, product and data science teams to develop new ideas, implement and test them, and measure success. Building CICD pipelines and developing project frameworks. Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation. End to End Design & development of Data platform for building a master source of Tesco Products. Involved in Design and analysis of new features and product using Scala & Spark/Kafka Frameworks to provide better and effective solution to business. Maintaining the existing application framework and ensure smooth executions of various processes running on cluster. Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members.

Design and Developed new modules and demonstrated abilities in key decision makings. Maintenance and Enhancements of existing modules and involved in re designing implementations. Involved in developing modules for new client involving technologies like Scala 2.10, Spark 1.5, Kafka 0.9 and Cassandra 2.2. Successfully developed and delivered couple of initiatives on big data analytics and large data processing using SparkSQL, Scala and Hive. Developed code on XML processing using Spark/Scala. Training and mentoring junior team members in Big Data technologies.

Understanding HDFS and Hadoop mechanism. Co coordinating with Architects and being part of initial set up of data pipelines using Hadoop map reduce, sqoop etc. Participating in design discussions and analyze the problem in detail to understand the key points. Interfacing with client for requirement gathering, finalizing technical specifications for our product. Working closely with Functional Team to support finalizing specification design document. Ensuring smooth implementation and testing of the application.

Interfacing with Onsite team for business gathering and finalizing technical / functional specifications. Involved in high level and Low level design for the project as lead. Monitoring multiple teams and working closely to support production issues as Lead. Fixing functional and performance defects.

Involved in development of software component for banking client. Developed multiple modules across projects and delivered on time. Provided support for production issues and fixes.

Interfacing with clients for business gathering, conducting system analysis and finalizing technical / functional specifications and high level design documents for the project. Independently handled module/Client and was solely responsible for the functionality and technical specifications of the module in the offshore team. Developed custom reports and SDD (Solution Description Documents) and successfully implemented and ensured proper unit testing before delivery. Participating in project management and testing as per requirement in the project.