NILOTPAL CHOWDHURY

Building data pipelines using Azure Data Factory, Azure Data Flow, Spark. Worked on internal product development using PySpark, Data Bricks. Understanding business requirement and worked as module lead for various projects. Developing and designing data migration projects from Legacy to Cloud. Migration from existing legacy data warehouse system to big data warehouse. Building data pipelines to implement Chance data capture. Technologies Used: Python, Azure Data Factory, Azure Data Flow, Azure Synapse, Data bricks, Spark, Azure.

Ilabs, Impetus Data warehouse. Currently working as a developer for modern data warehousing product. Migration of existing data warehouse to big data warehouse. Technologies Used: Java, Spark, Big Data, SQL, Hadoop.

Client: American direct broadcast satellite service provider. Involved in design and development of big data application. Big Data analysis using Spark R on AWS. Data validation and testing by running queries on Hive, SQL. HIVE optimization for reporting. Developing Big Data application in Spark and Java. Technologies Used: Java, Spark, HIVE, R, Big Data, SQL, Hadoop, Machine Learning, Statistical Analysis and Exploratory Data Analysis.

Client: American direct broadcast satellite service provider. Implementing business logic in java, worked on Big Data streaming platform like Spark, Data Torrent. Migrating existing business functionality from legacy systems to Big Data (Spark). Performing statistics & exploratory Data Analysis, on data using R. Performing predictive analytics on business rules. Tuning of machine learning algorithms. Designed parser for parsing business rules using Java, ANTLR. Performance monitoring and tuning of the big data application. Creating POC using map reduce programming. Designing hive databases based on the business requirements. Ensuring scalability of the big data application. Technologies Used: Java, Spark, HIVE, R, Big Data, SQL, SQOOP, Data Torrent, map reduce programming, Machine Learning, Statistical Analysis and Exploratory Data Analysis.

Client: Live chat application provider. Minor enhancements in mobile application using objective C, unit testing, implementing test driven methodology.