Lead Data Engineer

2 Days ago • All levels • Data Analysis

Job Summary

Job Description

Devoteam is a tech consulting firm specializing in cloud platforms, cybersecurity, data solutions, and sustainability. As a Lead Data Engineer, you will design, build, and maintain robust data infrastructures using cutting-edge technologies. Your role will involve transforming raw data into actionable insights to help clients make informed decisions and drive innovation. Key responsibilities include developing and optimizing ETL/ELT pipelines, integrating data from various sources, managing databases, implementing cloud-based data architectures, data modeling, and ensuring data quality and security. You will collaborate closely with Data Science, BI, Product, and Architecture teams.
Must have:
  • Strong Python expertise (pandas, NumPy, Polars, DuckDB)
  • Workflow orchestration with Airflow and Dagster
  • Data storage/formats like Parquet, Delta Lake, S3, ADLS
  • Experience with Kafka, Hadoop, Spark Streaming, and Flink
  • Knowledge of relational and NoSQL databases
  • Hands-on experience with cloud data platforms
  • Excellent communication and problem-solving skills
Good to have:
  • Experience developing and deploying machine learning models
  • Understanding of AI frameworks (TensorFlow, PyTorch, Scikit-learn)
  • Google Cloud Professional Data Engineer certification
  • Experience in regulated environments
  • Knowledge of Luxembourg's regulatory environment
Perks:
  • Partner with a multi-awarded, Best Workplace & premium consulting company
  • Vibrant work culture promoting innovation, knowledge sharing, and continuous learning
  • Continuous Growth with latest trends and top experts
  • Growth opportunities through mentoring and certifications
  • Unlimited access to Udemy Learning and Power Skills Academy
  • Work for a company valuing social impact, sustainability, and digital inclusion
  • Empower ideas through Devoteam Fondation and volunteering possibilities
  • Diverse team from over 25 nationalities
  • Emphasis on togetherness & celebrating successes

Job Details

Description de l'entreprise

Devoteam is an AI-driven tech consulting firm specializing in cloud platforms, cybersecurity, data solutions, and sustainability. With nearly 30 years of tech-native expertise, we guide businesses through sustainable digital transformations to deliver tangible value.

Present in over 25 countries across Europe, the Middle East, and Africa, and powered by over 11,000 collaborators, Devoteam is committed to leveraging technology to serve people. This commitment is strengthened by our strategic partnerships with leading cloud platforms like AWS, Google Cloud, Microsoft Azure, and ServiceNow.

In Luxembourg, we are a strong workforce of almost 150 professionals operating from 2 modern offices, including an Innovative Tech Department: a focused group of around 30 specialists in cutting-edge technologies. Embracing a vendor-agnostic approach, this team cultivates deep expertise across diverse cloud providers, open-source technologies, and other innovative tools, enabling us to craft tailored solutions that best fit our clients' needs.

Description du poste

As a Data Engineer at Devoteam, you will be instrumental in designing, building, and maintaining robust data infrastructures. You will work with cutting-edge technologies to transform raw data into actionable insights, enabling our clients to make informed decisions and drive innovation. We are looking for a passionate and skilled individual to join our Innovative Tech team and contribute to challenging and impactful projects.

Key Responsibilities

  • Development and optimization of ETL/ELT pipelines (batch & streaming);
  • Integration of data from structured and unstructured sources;
  • Design and management of relational and NoSQL databases;
  • Implementation of cloud-based data architectures (Data Lakehouse, Delta Lake, etc.);
  • Data modeling to support analysis and decision-making;
  • Ensuring data quality, security, governance, and performance;
  • Close collaboration with Data Science, BI, Product, and Architecture teams.

Qualifications

Must-have 

  • Technical Proficiency: Strong Python (pandas, NumPy, Polars, DuckDB) expertise along with workflow orchestration with Airflow and Dagster, and handling data storage/formats such as Parquet, Delta Lake, S3, and ADLS;
  • Data processing : Experience using Kafka, Hadoop, Spark Streaming, and Flink;
  • Database Expertise: Knowledge of relational and NoSQL databases including PostgreSQL, MySQL, SQL Server, MongoDB, and Cassandra;
  • Cloud Platforms: Hands-on experience with cloud data platforms like Databricks, Snowflake, GCP BigQuery, and AWS Redshift;
  • Agile Thinker & Communicator: A true team player with excellent communication skills, a knack for solving complex problems with a particular attention to detail, and the drive to take ownership and initiative.

Nice to have

  • Experience in developing and deploying machine learning models, and understanding of AI frameworks and libraries like TensorFlow, PyTorch, and Scikit-learn;
  • Certifications such as Google Cloud Professional Data Engineer or Google Cloud Machine Learning Engineer;
  • Experience in regulated environments (e.g., financial services, healthcare, critical infrastructure);
  • Knowledge of Luxembourg's regulatory environment, including CSSF regulations

Informations complémentaires

🌈 Partner with a multi-awarded, Best Workplace & premium consulting company in Luxembourg. Devoteam Luxembourg offers a vibrant work culture that promotes innovation, knowledge sharing, and continuous learning. When you join our team, you will enjoy:

  • 🚀 Continuous Growth. Surf with the latest trends, top experts, and extensive growth opportunities through mentoring, strong cloud partnerships (Microsoft, ServiceNow, ..), local Training Center, certifications programs, unlimited access to Udemy Learning and our Power Skills Academy;
  • 🌍 Be part of something bigger. Work for a company that values social impact, sustainability, and digital inclusion. Our CSR strategy will empower your ideas through the Devoteam Fondation and its volunteering possibilities;  
  • 🤝 Team Diversity.  Join a team of 130 tech-enthusiasts from more than 25 diverse nationalities where togetherness & celebrating successes are paramount. 

Devoteam stands for equal opportunities. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All our positions are open to people with disabilities.

Lieu du poste

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Luxembourg, Luxembourg, Luxembourg

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Cleveland, Ohio, United States (On-Site)

Cleveland, Ohio, United States (On-Site)

Cleveland, Ohio, United States (On-Site)

Cleveland, Ohio, United States (On-Site)

Cairo, Cairo Governorate, Egypt (On-Site)

Cairo, Cairo Governorate, Egypt (On-Site)

Lagoi, Kepulauan Riau, Indonesia (On-Site)

Paris, Île-de-France, France (On-Site)

Santa Fe, New Mexico, United States (On-Site)

Philadelphia, Pennsylvania, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Unbroken Studios

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug