Default profile banner
AS

ARPITHA S

@arpithas

Data Engineer

Bengaluru, India

Productiva IT SolutionsJSS College For Women

Experienced Data Engineer with over 3 years in IT, skilled in designing, developing, and maintaining data pipelines and ETL processes. Adept at data modeling, warehousing, and analytics, and eager to contribute expertise to an innovative organization.

Experience

Data engineer

Productiva IT Solutions

•Jan 2020•Bengaluru

Proficient in writing basic SQL queries to retrieve and manipulate data from relational databases. Experience in extracting data from databases and generating reports to support business operations. Understanding of relational database design principles, including table creation, primary and foreign keys. Conducted data cleaning and validation using SQL to ensure data quality and accuracy. Skilled in performing basic joins and subqueries to combine data from multiple tables and perform complex queries. Designed and implemented end-to-end data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Established a data pipeline where files arriving at an S3 location are ingested and transformed using PySpark, followed by loading the processed data back into both S3 and an Aurora database, seamlessly integrating PySpark, SQL, and Python technologies within the pipeline. Developed and maintained data pipelines on AWS, utilizing services such as S3, Glue to ensure reliable and scalable data storage, ETL, and processing. Collaborated with cross-functional teams to understand data requirements and implement solutions to meet business objectives. Utilized SQL and Python to perform data analysis, troubleshoot issues, and optimize performance of data pipelines. Worked collaboratively with senior data engineers and documented SQL scripts and database changes for project tracking.

Education

JSS College For Women

Master of Business Administration

MBA

Apr 2017 - May 2019

Mysore

Bachelor of Computer Applications

Computer Applications

Apr 2014 - Apr 2017

Skills

SQL
mysql
python
Spark
pyspark
aws