Kajal Tiwari

Served as Big Data Associate and contributed to developing, testing, and writing codes from scratch. Demonstrated excellence in developing code with Spark and Scala along with debugging and fixing issues. Designed and developed data loading strategies, transformation for business to analyze the datasets. Processed flat files in various file formats and stored them in various partition models in HDFS. Responsible for building, develop, testing shared components that will be used across modules. Responsible in performing sort, join, aggregations, filters and other transformations on the datasets using Spark. Experience in extracting appropriate features from data sets in order to handle bad, null, partial records using Spark SQL. Involved in converting Hive/SQL queries into Spark transformations using Spark RDD’s. Managing and scheduling jobs on a Hadoop cluster using Yarn via Autosys. Responsible for creating Hive tables, loading with data and writing Hive queries.

Working as a consultant for a client on a project based on US share market where data is loaded using Scala and the execution engine is Spark.