Don Palayoor

As a dedicated Freelance Data Specialist, I bring a strong background in ETL pipelines, web scraping, and data analysis. I have a proven track record in designing and implementing efficient data management systems, extracting valuable insights from complex data sets, and presenting these insights in a clear and understandable manner. My expertise includes proficiency in Python, R, and Java, along with extensive experience with web scraping libraries and data visualization tools.

Developing Hive and Impala queries to transform data based on the mapping documents given by the business. Developing Shell Script framework for data ingestion, data transformation, data export & data archival. Worked in Control-M tool for scheduling and monitoring jobs. Developed a Spark framework for converting Oozie jobs to Spark Jobs. Used Jira for project tracking and Project Management as part of user stories. Configured Tableau Extract Refresh using Python scripts and Control-M. Documentation using Confluence. Implemented Spark using Scala and SparkSQL for faster testing and processing of data. Developed a pipeline for ETL workflow in Azure. Created pipelines for movement of data from Hadoop to Azure Cloud Platform. Used Bit-Bucket and JIRA for collaboration on code with inline comments and pull requests.