Data Engineer (Freelance)

Catalys

Job Summary

CATALYS is seeking a highly experienced freelance Data Engineer with over 10 years of experience. The role focuses on designing, building, and maintaining scalable ETL pipelines on Azure, primarily using Azure Data Factory (ADF) for orchestration and Python for data processing. Responsibilities include ingesting data from various sources, implementing data validation, optimizing workflows, and collaborating with stakeholders to deliver reliable datasets.

Must Have

  • 10+ years of experience as a Data Engineer with strong ETL focus
  • Deep hands-on experience with Azure Data Factory (ADF)
  • Python as the primary language for ETL and data processing
  • Strong understanding of ETL / ELT concepts and data workflows
  • Experience working with Azure data services (ADLS, Databricks, Synapse)
  • Strong SQL skills and experience with relational databases
  • Experience using Git for version control

Good to Have

  • Experience with Databricks / PySpark
  • Exposure to Airflow or similar orchestration tools
  • Familiarity with Docker or Kubernetes
  • Experience with Snowflake or PostgreSQL

Job Description

Posted on:

December 29, 2025

##### ‍About the Role

We are looking for a highly experienced Data Engineer with strong expertise in building and managing ETL pipelines on Azure. This is a contract role focused on hands-on delivery, where Azure Data Factory (ADF) is the primary orchestration tool and Python is used extensively for data processing and transformations.

##### Key Responsibilities

  • Design, build, and maintain scalable ETL pipelines using Azure Data Factory (ADF)
  • Develop and maintain Python-based data transformation logic
  • Ingest data from APIs, databases, and flat files into Azure data platforms
  • Implement data validation, quality checks, and error handling within pipelines
  • Optimize ETL workflows for performance, reliability, and cost efficiency
  • Collaborate with internal stakeholders to understand data requirements and deliver reliable datasets
  • Troubleshoot and resolve data pipeline issues in production environments

##### Must-Have Skills

  • 10+ years of experience as a Data Engineer with strong ETL focus
  • Deep hands-on experience with Azure Data Factory (ADF)
  • Python as the primary language for ETL and data processing
  • Strong understanding of ETL / ELT concepts and data workflows
  • Experience working with Azure data services (ADLS, Databricks, Synapse)
  • Strong SQL skills and experience with relational databases
  • Experience using Git for version control

##### Good to Have

  • Experience with Databricks / PySpark
  • Exposure to Airflow or similar orchestration tools
  • Familiarity with Docker or Kubernetes
  • Experience with Snowflake or PostgreSQL

9 Skills Required For This Role

Github Game Texts Postgresql Azure Docker Kubernetes Git Python Sql

Similar Jobs