Lead Data Engineer

2 Months ago • All levels • Data Analysis

Job Summary

Job Description

Devoteam is a tech consulting firm specializing in cloud platforms, cybersecurity, data solutions, and sustainability. As a Lead Data Engineer, you will design, build, and maintain robust data infrastructures using cutting-edge technologies. Your role will involve transforming raw data into actionable insights to help clients make informed decisions and drive innovation. Key responsibilities include developing and optimizing ETL/ELT pipelines, integrating data from various sources, managing databases, implementing cloud-based data architectures, data modeling, and ensuring data quality and security. You will collaborate closely with Data Science, BI, Product, and Architecture teams.
Must have:
  • Strong Python expertise (pandas, NumPy, Polars, DuckDB)
  • Workflow orchestration with Airflow and Dagster
  • Data storage/formats like Parquet, Delta Lake, S3, ADLS
  • Experience with Kafka, Hadoop, Spark Streaming, and Flink
  • Knowledge of relational and NoSQL databases
  • Hands-on experience with cloud data platforms
  • Excellent communication and problem-solving skills
Good to have:
  • Experience developing and deploying machine learning models
  • Understanding of AI frameworks (TensorFlow, PyTorch, Scikit-learn)
  • Google Cloud Professional Data Engineer certification
  • Experience in regulated environments
  • Knowledge of Luxembourg's regulatory environment
Perks:
  • Partner with a multi-awarded, Best Workplace & premium consulting company
  • Vibrant work culture promoting innovation, knowledge sharing, and continuous learning
  • Continuous Growth with latest trends and top experts
  • Growth opportunities through mentoring and certifications
  • Unlimited access to Udemy Learning and Power Skills Academy
  • Work for a company valuing social impact, sustainability, and digital inclusion
  • Empower ideas through Devoteam Fondation and volunteering possibilities
  • Diverse team from over 25 nationalities
  • Emphasis on togetherness & celebrating successes

Job Details

Description de l'entreprise

Devoteam is an AI-driven tech consulting firm specializing in cloud platforms, cybersecurity, data solutions, and sustainability. With nearly 30 years of tech-native expertise, we guide businesses through sustainable digital transformations to deliver tangible value.

Present in over 25 countries across Europe, the Middle East, and Africa, and powered by over 11,000 collaborators, Devoteam is committed to leveraging technology to serve people. This commitment is strengthened by our strategic partnerships with leading cloud platforms like AWS, Google Cloud, Microsoft Azure, and ServiceNow.

In Luxembourg, we are a strong workforce of almost 150 professionals operating from 2 modern offices, including an Innovative Tech Department: a focused group of around 30 specialists in cutting-edge technologies. Embracing a vendor-agnostic approach, this team cultivates deep expertise across diverse cloud providers, open-source technologies, and other innovative tools, enabling us to craft tailored solutions that best fit our clients' needs.

Description du poste

As a Data Engineer at Devoteam, you will be instrumental in designing, building, and maintaining robust data infrastructures. You will work with cutting-edge technologies to transform raw data into actionable insights, enabling our clients to make informed decisions and drive innovation. We are looking for a passionate and skilled individual to join our Innovative Tech team and contribute to challenging and impactful projects.

Key Responsibilities

  • Development and optimization of ETL/ELT pipelines (batch & streaming);
  • Integration of data from structured and unstructured sources;
  • Design and management of relational and NoSQL databases;
  • Implementation of cloud-based data architectures (Data Lakehouse, Delta Lake, etc.);
  • Data modeling to support analysis and decision-making;
  • Ensuring data quality, security, governance, and performance;
  • Close collaboration with Data Science, BI, Product, and Architecture teams.

Qualifications

Must-have 

  • Technical Proficiency: Strong Python (pandas, NumPy, Polars, DuckDB) expertise along with workflow orchestration with Airflow and Dagster, and handling data storage/formats such as Parquet, Delta Lake, S3, and ADLS;
  • Data processing : Experience using Kafka, Hadoop, Spark Streaming, and Flink;
  • Database Expertise: Knowledge of relational and NoSQL databases including PostgreSQL, MySQL, SQL Server, MongoDB, and Cassandra;
  • Cloud Platforms: Hands-on experience with cloud data platforms like Databricks, Snowflake, GCP BigQuery, and AWS Redshift;
  • Agile Thinker & Communicator: A true team player with excellent communication skills, a knack for solving complex problems with a particular attention to detail, and the drive to take ownership and initiative.

Nice to have

  • Experience in developing and deploying machine learning models, and understanding of AI frameworks and libraries like TensorFlow, PyTorch, and Scikit-learn;
  • Certifications such as Google Cloud Professional Data Engineer or Google Cloud Machine Learning Engineer;
  • Experience in regulated environments (e.g., financial services, healthcare, critical infrastructure);
  • Knowledge of Luxembourg's regulatory environment, including CSSF regulations

Informations complémentaires

🌈 Partner with a multi-awarded, Best Workplace & premium consulting company in Luxembourg. Devoteam Luxembourg offers a vibrant work culture that promotes innovation, knowledge sharing, and continuous learning. When you join our team, you will enjoy:

  • 🚀 Continuous Growth. Surf with the latest trends, top experts, and extensive growth opportunities through mentoring, strong cloud partnerships (Microsoft, ServiceNow, ..), local Training Center, certifications programs, unlimited access to Udemy Learning and our Power Skills Academy;
  • 🌍 Be part of something bigger. Work for a company that values social impact, sustainability, and digital inclusion. Our CSR strategy will empower your ideas through the Devoteam Fondation and its volunteering possibilities;  
  • 🤝 Team Diversity.  Join a team of 130 tech-enthusiasts from more than 25 diverse nationalities where togetherness & celebrating successes are paramount. 

Devoteam stands for equal opportunities. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All our positions are open to people with disabilities.

Lieu du poste

Similar Jobs

Mako IT Lab - Principal Software Engineer

Mako IT Lab

Chennai, Tamil Nadu, India (On-Site)
11 Months ago
bombit - Game Designer

bombit

Poland (Hybrid)
2 Months ago
Dream Sports - Manager - B2B Sales

Dream Sports

Mumbai, Maharashtra, India (On-Site)
5 Months ago
Corsair gaming - Test Engineer

Corsair gaming

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
3 Months ago
ISS Stoxx - ESG Research Analyst - Norm-Based Research

ISS Stoxx

Mumbai, Maharashtra, India (On-Site)
2 Years ago
zeta - Manager - Data Analytics, Credit Card Portfolios

zeta

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Nagarro - Senior Staff Consultant, Business Analyst

Nagarro

South Africa (On-Site)
9 Months ago
blend - Senior Data Scientist

blend

Hyderabad, Telangana, India (On-Site)
2 Months ago
Valve corporation - Statistician / Data Scientist

Valve corporation

Bellevue, Washington, United States (On-Site)
9 Months ago
HCL Tech - Senior data scientist

HCL Tech

Texas, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

GoMotive - Senior Manager, FP&A

GoMotive

United States (Remote)
1 Month ago
WaveApps - Technology Operations & Program Manager

WaveApps

Toronto, Ontario, Canada (Remote)
4 Months ago
Findhelp - Staff Technical Solutions Account Manager

Findhelp

Madison, Wisconsin, United States (On-Site)
4 Months ago
Argus - Site Reliability Engineer (LATAM)

Argus

(Remote)
5 Months ago
Lead Venture - AR Manager

Lead Venture

Guadalajara, Jalisco, Mexico (Remote)
4 Weeks ago
zoox - Program Manager, Contingent Workforce Process, Systems & Tools

zoox

Foster City, California, United States (Hybrid)
4 Months ago
Rhino Entertainment Group - Senior Technical Project Manager

Rhino Entertainment Group

Sliema, Malta (Hybrid)
3 Months ago
Dream Sports - MISE - Sales (Delhi)

Dream Sports

Delhi, India (On-Site)
7 Months ago
Nordson Corporation - Operations Finance Manager

Nordson Corporation

Carlsbad, California, United States (On-Site)
2 Months ago
Relax Gaming - Game Product Owner

Relax Gaming

Malmö, Skåne County, Sweden (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Luxembourg, Luxembourg, Luxembourg

Square - Senior Consultant (Regulatory, Compliance, Legal)

Square

Luxembourg (On-Site)
4 Weeks ago
ARHS - M365 Expert / System Admin

ARHS

Luxembourg (On-Site)
10 Months ago
Square - Commercial Advisor

Square

Luxembourg (On-Site)
1 Month ago
ARHS - Service Desk Agent

ARHS

Luxembourg (On-Site)
1 Month ago
PwC - Senior Manager Transfer Pricing

PwC

Luxembourg (On-Site)
2 Months ago
PwC - Manager / Senior Manager Corporate Tax Consulting (m/f/d)

PwC

Luxembourg (On-Site)
10 Months ago
SSC Technologies - Associate Manager, Hedge Fund Accounting

SSC Technologies

Luxembourg, Luxembourg, Luxembourg (On-Site)
2 Months ago
PayPal - CFO

PayPal

Luxembourg, Luxembourg, Luxembourg (Hybrid)
2 Months ago
PayPal - Manager, Tax Reporting and Compliance

PayPal

Luxembourg, Luxembourg, Luxembourg (Hybrid)
2 Months ago
Square - IAM Consultant CyberArk

Square

Leudelange, Esch-sur-Alzette, Luxembourg (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Western Digital - Intern - Data Science (Studying Bachelor Degree)

Western Digital

Phra Nakhon Si Ayutthaya, Thailand (On-Site)
1 Month ago
Addepar - Staff Software Engineer - Data Intelligence

Addepar

New York, New York, United States (On-Site)
3 Months ago
hitberry games - IT Business Analyst

hitberry games

(Remote)
2 Years ago
Springer Group - Business Analyst

Springer Group

Lisbon, Lisbon, Portugal (On-Site)
2 Months ago
velotio technologies  - Senior Engineer (Data Engineer- Databricks)

velotio technologies

Pune, Maharashtra, India (Remote)
3 Months ago
Car Gurus - Senior Sales Data Analyst

Car Gurus

Boston, Massachusetts, United States (Hybrid)
2 Months ago
Addepar - Sr. Software Engineer - Reference Data

Addepar

United States (Remote)
3 Months ago
USE Insider - Senior Software Engineer (Data Service Platform)

USE Insider

Istanbul, İstanbul, Türkiye (Remote)
12 Months ago
appier - Data Scientist

appier

Taipei City, Taiwan (On-Site)
3 Months ago
Condé Nast - Data Scientist Manager

Condé Nast

New York, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Amsterdam, North Holland, Netherlands (On-Site)

Barcelona, Catalonia, Spain (On-Site)

Amsterdam, North Holland, Netherlands (On-Site)

Amsterdam, North Holland, Netherlands (Remote)

Amsterdam, North Holland, Netherlands (Hybrid)

Amsterdam, North Holland, Netherlands (On-Site)

Amsterdam, North Holland, Netherlands (On-Site)

Barcelona, Catalonia, Spain (Remote)

View All Jobs

Get notified when new jobs are added by Devoteam

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug