Default profile banner
RD

Rani Dalvi

@ranidalvi

Big Data Developer at INFISTER TECHNOLOGY PRIVATE LIMITED

Aurangabad, Maharashtra, INDIA

www.linkedin.com/in/rani-dalvi-1480a3276/

INFISTER TECHNOLOGY PRIVATE LIMITEDDr. B. A. T. U. Lonere

Rani Dalvi is a Big Data Developer with over 3 years of experience in data engineering and analytics. Proficient in developing scalable data pipelines using PySpark, AWS services (S3, Glue, Redshift), and ETL concepts. Expertise includes data modeling, SQL query writing, and migrating databases, such as Oracle to Snowflake, ensuring data integrity and optimizing cloud infrastructure.

Experience

Big data Developer

INFISTER TECHNOLOGY PRIVATE LIMITED

Full-time•Feb 2022 - Present•Pune

Import data from S3 raw bucket and perform cleaning and masking before moving data to s3 cleanse bucket using glue. Worked on transformation glue job to move data from s3 cleanse to the redshift dimensional and fact tables. Applied joins and SCD type 1 & 2 logic in glue pyspark script. Created DDL script for creating tables in redshift. Validated records after transformation glue job completed loading data into redshift. Worked with teammates to understand and support data import from source to S3 using AWS DMS. Assisted with orchestration purpose and configuration of step function.

Data Engineer

INFISTER TECHNOLOGY PRIVATE LIMITED

Full-time•Feb 2020 - Aug 2021

Extracted, Loaded, and Transformed data using Snowflake utilities (SnowSQL). Involved in importing data from Oracle and storing it into AWS S3 Bucket. Wrote SQL queries against Snowflake and developed scripts. Hands-on experience with Snowflake utilities including SnowSQL, SnowPipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures. Responsible for analyzing and cleansing raw data by performing SnowSQL Queries. Applied ETL concept and modeling structure principles. Solved Jira Tickets Raised by Clients.

Education

Dr. B. A. T. U. Lonere

Master of Technology

Computer Science Engineering

Present

Dr. B. A. M. U. Aurangabad

Bachelor of Engineering

Information and Technology

Skills

Python
SQL
PySpark
AWS
AWS S3
AWS Glue
AWS Lambda
Step Function
DMS
IAM Role
Redshift
Snowflake
MySQL
Oracle
Apache Spark
Apache Ni-Fi
HDFS
Sqoop
Hive
ETL
Data modeling
Apache Kafka
Parquet
ORC
CSV
AVRO
Jira
Agile
Linux
Windows