AYESHA SHAIKH

As a Data Engineer, worked on data automation, extraction, and availability in BCM and CPG projects. Worked on comprehensive data extraction from MSTR/ other sources for demand/planning and additional master datasets. Data mining and converting data to suitable format and upload into Databricks. Implemented automated spark jobs with multiple concurrent tasks and scheduling these jobs in Databricks. Supported the development of complete automation process for data transformation and data handling (Treasury and Regulatory reporting). Also responsible for Data analysis. Worked on different AWS services like S3, Apache Airflow, DMS, etc. Created Airflow DAGs on the basis of different frameworks. Implementing pipeline for CICD process including CodeCommit, CodeBuild, Code Pipeline, ECR and ECS. Integrating data from various sources into the Snowflake platform, created DAGs having multiple tasks. Provided understandable and clear documentation on the data assets (Confluence). Hands on experience on latest technologies and platforms- Python, SQL, Databricks, Spark.

Worked on Autonomous Vehicle project to process data and data accuracy and quality of images taken by driverless vehicle cameras. Responsible for QA and testing the processed data and sending it for further validation. Generated data quality dashboards on Tableau. Image processed for high beams, parking, weather conditions, surroundings, path and pedestrians. Tools used- Hatch, Tableau and SQL.