Data Engineer (Azure)

3 Months ago • 3 Years +
Data Analysis

Job Description

We are seeking a skilled and analytical Data Engineer to join our team in Colombia. In this role, you will be responsible for designing, implementing, and maintaining robust data infrastructure to support our organization's data-driven decision-making processes. You will design, develop, and maintain scalable data pipelines, collaborate with data scientists and analysts, optimize data storage, implement data quality checks, develop documentation, stay up-to-date with technologies, troubleshoot issues, and ensure data security and compliance.
Must Have:
  • 3+ years of data engineering experience.
  • Proficiency in Python, Scala, and SQL.
  • Experience with Apache Spark and Databricks.
  • Experience with Microsoft Azure (ADF, Event Hub, Functions).
  • Experience with data pipelines and ETL/ELT design.
  • Experience with data storage and management (Delta Tables, Azure Data Lake).
  • Experience with orchestration and integration tools (ADF, Functions).
  • Knowledge of workflow and automation tools (CI/CD, Git).
  • Knowledge of data modeling and warehousing.
  • Experience with monitoring and optimization.
  • Experience with collaboration tools (Jira, Confluence).
Perks:
  • Competitive salary package, share plan, referral bonus.
  • Career coaching, global career opportunities, internal development programs.
  • Complex projects, rotations, internal tech communities, training, certifications.
  • Hybrid work and flexible working hours, employee assistance programme.
  • Global internal wellbeing programme, access to wellbeing apps.
  • Global internal tech communities, hobby clubs, inclusion and diversity programs.

Add these skills to join the top 1% applicants for this job

team-management
data-analytics
github
talent-acquisition
agile-development
azure
spark
microsoft-azure
ci-cd
confluence
git
python
sql
scala
jira

Company Description

Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.
 
By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.
 
From prototype to real-world impact - be part of a global shift by doing work that matters.

Job Description

We are seeking a skilled and analytical Data Engineer to join our team in Colombia. In this role, you will be responsible for designing, implementing, and maintaining robust data infrastructure to support our organization's data-driven decision-making processes.

  • Design, develop, and maintain scalable data pipelines to extract, transform, and load data from various sources.
  • Collaborate with data scientists and analysts to understand data requirements and implement efficient data models.
  • Optimize data storage and retrieval systems to ensure high performance and reliability.
  • Implement and maintain data quality checks and monitoring systems.
  • Develop and maintain documentation for data processes and architectures.
  • Stay up-to-date with emerging technologies and best practices in data engineering.
  • Troubleshoot and resolve data-related issues in a timely manner.
  • Ensure data security and compliance with relevant regulations and company policies.

Qualifications

  • 3+ years of experience in data engineering or a related role.
  • Programming Languages: Python, Scala, SQL

  • Big Data Frameworks: Apache Spark, Databricks (including Delta Lake and Delta Tables)

  • Cloud Platforms & Services: Microsoft Azure (Azure Data Factory, Azure Event Hub, Azure Functions)

  • Data Engineering: Data pipelines, ETL/ELT design, batch and streaming data processing

  • Data Storage & Management: Delta Tables, Azure Data Lake, Azure Blob Storage

  • Orchestration & Integration: Azure Data Factory (ADF), Azure Functions, Event-driven architecture

  • Workflow & Automation Tools: CI/CD pipelines, version control (Git), DevOps practices

  • Data Modeling & Warehousing: Dimensional modeling, data lakes, lakehouse architectures

  • Monitoring & Optimization: Performance tuning in Spark, job monitoring with Azure tools

  • Collaboration Tools: Jira, Confluence, Agile/Scrum methodologies

Additional Information

Discover some of the global benefits that empower our people to become the best version of themselves:

  • Finance: Competitive salary package, share plan, referral bonus;  
  • Career Development: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
  • Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
  • Work-Life Balance: Hybrid work and flexible working hours, employee assistance programme;
  • Health: Global internal wellbeing programme, access to wellbeing apps;
  • Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.

In compliance with the Law 1581 of 2012, Endava S.A.S. / Endava Colombia S.A.S, identified with NIT. Nº 900.955.679-3 / N° 900.594.521-9 , with an address at Street 96 No. 10 – 38, floor 7th in the city of Bogotá and Career 48 No. 18A – 14 Floor 19, with telephone number (+571) 3905061, (hereinafter referred as “ENDAVA” or the “Organization”), as RESPONSIBLE for the processing of personal information informs:

Keep in mind that once you decide to participate in ENDAVA COLOMBIA's recruitment processes, the physical delivery or sending via e-mail your resume implies the express acceptance, through conclusive behavior, of authorizing ENDAVA to process your data with the purpose to participate in the recruitment processes in the Organization. In particular, the personal data provided shall be part of our "Talent Bank" for a maximum term of two (2) years, which shall be stored on servers located outside the country and may be processed for the purpose of; verifying compliance with the requirements to participate in the Organization's current and/or future recruitment processes; execute interviews and in general, send notifications related to the recruitment processes. In case your resume is not pre-selected, it shall be permanently deleted. ENDAVA guarantees that the personal data obtained shall be used only for the announced purposes and shall be kept for the time required by law.

You, and every personal information owner, have the right to: know, update and rectify your personal data; access to it free of charge; to be informed about its use; request proof of authorization; file complaints for violations of the provisions of current regulations before the Superintendence of Industry and Commerce. Finally, in some applicable cases, modify and revoke the consent given and/or request the deletion of your personal information.

For any additional information related to the processing of your personal data, our Personal Information Processing Policy, and/or exercising of your right to the habeas data, you can contact us through the service channel provided by ENDAVA: protecciondatoscolombia@endava.com.

At Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives—because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.

Set alerts for more jobs like Data Engineer (Azure)
Set alerts for new jobs by endava
Set alerts for new Data Analysis jobs in Colombia
Set alerts for new jobs in Colombia
Set alerts for Data Analysis (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙