Arin Arora
@Arinarora
Software Development Engineer at Sigmoid Analytics
Bengaluru
Software Development Engineer at Sigmoid Analytics with a B.E. in Computer Science and Engineering from Birla Institute of Technology (BIT), Mesra. Experienced in building end-to-end ETL pipelines using Apache Spark, Databricks, Azure, SQL, and Python. Certified Databricks Data Engineer Associate and Microsoft Certified Azure Data Engineer Associate.
Experience
Software Development Engineer
Sigmoid Analytics
Built end-to-end ETL pipelines with Apache Spark, Databricks, Azure, SQL, and Python processing terabytes of data. Automated ingestion of large structured/unstructured data into Azure Data Lake Storage (ADLS) using PySpark, ensuring GDPR compliance for PII encryption in European markets. Delivered optimized big data solutions with reduced query latency. Reduced dashboard infrastructure cost by 65% through a comprehensive cross-platform marketing analytics solution. Engineered identity resolution workflows to consolidate PII data from 20+ sources, resolving customer identities with 95% accuracy to create unified customer profiles for marketing campaigns.
Data Engineering Associate
Sigmoid Analytics
Gained expertise in Data Engineering principles and implementation. Built end-to-end pipelines for various sources using Jinja templates, reducing new source onboarding time by 70% via reusable DAGs in Apache Airflow.
Education
Birla Institute of Technology (BIT), Mesra
B.E.
Computer Science and Engineering
Licenses & Certifications
Databricks Certified Data Engineer Associate
Databricks
Microsoft Certified: Azure Data Engineer Associate (DP-203)
Microsoft