Senior Data Engineer

endava

Job Summary

Endava is seeking a Senior Data Engineer to join their data team, focusing on transforming raw data into actionable insights and building robust data infrastructures. The role involves designing and implementing cloud-native data architectures on Microsoft Azure, optimizing ETL/ELT pipelines, and ensuring data quality. The ideal candidate will have expertise in big data solutions, data modeling, and promoting best practices in data security and governance, contributing to data-driven innovation.

Must Have

  • Collaborate with engineering teams and business stakeholders to define efficient data processing flows.
  • Design and implement cloud-native data architectures and deployment flows, primarily on Microsoft Azure.
  • Build, optimize, and maintain ETL/ELT pipelines and data cleaning and transforming.
  • Model relational and dimensional data structures aligned with platform capabilities.
  • Ensure data quality, integrity, and observability using tools like dbt, Datadog, and Azure monitoring.
  • Develop and maintain big data solutions leveraging technologies such as Spark, Databricks, and Snowflake.
  • Promote best practices in data security, governance, and Agile collaboration.
  • 5+ years of experience in Data Engineering, ideally within cloud environments.
  • Strong proficiency in Python and SQL, including scripting, testing (Pytest/Unittest), and optimization.
  • Deep understanding of data warehousing, data modeling, and data design principles.
  • Proven experience implementing and managing ETL/ELT processes and data pipelines.
  • Hands-on experience with Azure Data Factory, Databricks, Blob Storage, Dataflow, Functions, KeyVault, and Azure DevOps.
  • Working knowledge of Snowflake or Databricks and Data Build Tool (dbt).
  • Experience with data monitoring and observability tools (e.g., Datadog).

Perks & Benefits

  • Competitive salary package
  • Share plan
  • Company performance bonuses
  • Value-based recognition awards
  • Referral bonus
  • Career coaching
  • Global career opportunities
  • Non-linear career paths
  • Internal development programmes for management and technical leadership
  • Complex projects
  • Rotations
  • Internal tech communities
  • Training
  • Certifications
  • Coaching
  • Online learning platforms subscriptions
  • Pass-it-on sessions
  • Workshops
  • Conferences
  • Hybrid work and flexible working hours
  • Employee assistance programme
  • Global internal wellbeing programme
  • Access to wellbeing apps
  • Hobby clubs and interest groups
  • Inclusion and diversity programmes
  • Events and celebrations

Job Description

Company Description

Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change. By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses. From prototype to real-world impact - be part of a global shift by doing work that matters.

Job Description

Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling.

Responsibilities:

  • Collaborate with engineering teams and business stakeholders to understand evolving needs and define efficient data processing flows, data usage patterns and dependencies in complex ecosystems, as well as and interactive reports.
  • Design and implement cloud-native data architectures and deployment flows, primarily on Microsoft Azure.
  • Build, optimize, and maintain ETL/ELT pipelines and data cleaning and transforming to meet business and platform needs.
  • Model relational and dimensional data structures aligned with platform capabilities.
  • Ensure data quality, integrity, and observability, using tools like dbt, Datadog, and Azure monitoring.
  • Develop and maintain big data solutions leveraging technologies such as Spark, Databricks, and Snowflake.
  • Promote best practices in data security, governance, and Agile collaboration.
  • Lead initiatives improving platform scalability and data-driven innovation.
  • Model front-end and back-end data sources to help draw a more comprehensive picture of user flows throughout the system and to enable powerful data analysis.
  • Develop models that can be used to make predictions and answer questions for the overall business.

Qualifications

  • 5+ years of experience in Data Engineering, ideally within cloud environments.
  • Strong proficiency in Python and SQL, including experience in scripting, testing (Pytest/Unittest), and optimization.
  • Deep understanding of data warehousing, data modeling, and data design principles.
  • Proven experience implementing and managing ETL/ELT processes and data pipelines.
  • Hands-on experience with Azure Data Factory, Databricks, Blob Storage, Dataflow, Functions, KeyVault, and Azure DevOps.
  • Working knowledge of Snowflake or Databricks and Data Build Tool (dbt).
  • Experience with data monitoring and observability tools (e.g., Datadog).

Additional Information

Discover some of the global benefits that empower our people to become the best version of themselves:

  • Finance: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus;
  • Career Development: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
  • Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
  • Work-Life Balance: Hybrid work and flexible working hours, employee assistance programme;
  • Health: Global internal wellbeing programme, access to wellbeing apps;
  • Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.

At Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives—because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.

16 Skills Required For This Role

Team Management Data Analytics Talent Acquisition Data Structures Game Texts Agile Development Azure Azure Devops Spark Microsoft Azure Data Science Front End Back End Python Sql Machine Learning

Similar Jobs