Lead Data Engineer

1 Month ago • All levels • Data Analysis

Job Summary

Job Description

Devoteam is a tech consulting firm specializing in cloud platforms, cybersecurity, data solutions, and sustainability. As a Lead Data Engineer, you will design, build, and maintain robust data infrastructures using cutting-edge technologies. Your role will involve transforming raw data into actionable insights to help clients make informed decisions and drive innovation. Key responsibilities include developing and optimizing ETL/ELT pipelines, integrating data from various sources, managing databases, implementing cloud-based data architectures, data modeling, and ensuring data quality and security. You will collaborate closely with Data Science, BI, Product, and Architecture teams.
Must have:
  • Strong Python expertise (pandas, NumPy, Polars, DuckDB)
  • Workflow orchestration with Airflow and Dagster
  • Data storage/formats like Parquet, Delta Lake, S3, ADLS
  • Experience with Kafka, Hadoop, Spark Streaming, and Flink
  • Knowledge of relational and NoSQL databases
  • Hands-on experience with cloud data platforms
  • Excellent communication and problem-solving skills
Good to have:
  • Experience developing and deploying machine learning models
  • Understanding of AI frameworks (TensorFlow, PyTorch, Scikit-learn)
  • Google Cloud Professional Data Engineer certification
  • Experience in regulated environments
  • Knowledge of Luxembourg's regulatory environment
Perks:
  • Partner with a multi-awarded, Best Workplace & premium consulting company
  • Vibrant work culture promoting innovation, knowledge sharing, and continuous learning
  • Continuous Growth with latest trends and top experts
  • Growth opportunities through mentoring and certifications
  • Unlimited access to Udemy Learning and Power Skills Academy
  • Work for a company valuing social impact, sustainability, and digital inclusion
  • Empower ideas through Devoteam Fondation and volunteering possibilities
  • Diverse team from over 25 nationalities
  • Emphasis on togetherness & celebrating successes

Job Details

Description de l'entreprise

Devoteam is an AI-driven tech consulting firm specializing in cloud platforms, cybersecurity, data solutions, and sustainability. With nearly 30 years of tech-native expertise, we guide businesses through sustainable digital transformations to deliver tangible value.

Present in over 25 countries across Europe, the Middle East, and Africa, and powered by over 11,000 collaborators, Devoteam is committed to leveraging technology to serve people. This commitment is strengthened by our strategic partnerships with leading cloud platforms like AWS, Google Cloud, Microsoft Azure, and ServiceNow.

In Luxembourg, we are a strong workforce of almost 150 professionals operating from 2 modern offices, including an Innovative Tech Department: a focused group of around 30 specialists in cutting-edge technologies. Embracing a vendor-agnostic approach, this team cultivates deep expertise across diverse cloud providers, open-source technologies, and other innovative tools, enabling us to craft tailored solutions that best fit our clients' needs.

Description du poste

As a Data Engineer at Devoteam, you will be instrumental in designing, building, and maintaining robust data infrastructures. You will work with cutting-edge technologies to transform raw data into actionable insights, enabling our clients to make informed decisions and drive innovation. We are looking for a passionate and skilled individual to join our Innovative Tech team and contribute to challenging and impactful projects.

Key Responsibilities

  • Development and optimization of ETL/ELT pipelines (batch & streaming);
  • Integration of data from structured and unstructured sources;
  • Design and management of relational and NoSQL databases;
  • Implementation of cloud-based data architectures (Data Lakehouse, Delta Lake, etc.);
  • Data modeling to support analysis and decision-making;
  • Ensuring data quality, security, governance, and performance;
  • Close collaboration with Data Science, BI, Product, and Architecture teams.

Qualifications

Must-have 

  • Technical Proficiency: Strong Python (pandas, NumPy, Polars, DuckDB) expertise along with workflow orchestration with Airflow and Dagster, and handling data storage/formats such as Parquet, Delta Lake, S3, and ADLS;
  • Data processing : Experience using Kafka, Hadoop, Spark Streaming, and Flink;
  • Database Expertise: Knowledge of relational and NoSQL databases including PostgreSQL, MySQL, SQL Server, MongoDB, and Cassandra;
  • Cloud Platforms: Hands-on experience with cloud data platforms like Databricks, Snowflake, GCP BigQuery, and AWS Redshift;
  • Agile Thinker & Communicator: A true team player with excellent communication skills, a knack for solving complex problems with a particular attention to detail, and the drive to take ownership and initiative.

Nice to have

  • Experience in developing and deploying machine learning models, and understanding of AI frameworks and libraries like TensorFlow, PyTorch, and Scikit-learn;
  • Certifications such as Google Cloud Professional Data Engineer or Google Cloud Machine Learning Engineer;
  • Experience in regulated environments (e.g., financial services, healthcare, critical infrastructure);
  • Knowledge of Luxembourg's regulatory environment, including CSSF regulations

Informations complémentaires

🌈 Partner with a multi-awarded, Best Workplace & premium consulting company in Luxembourg. Devoteam Luxembourg offers a vibrant work culture that promotes innovation, knowledge sharing, and continuous learning. When you join our team, you will enjoy:

  • 🚀 Continuous Growth. Surf with the latest trends, top experts, and extensive growth opportunities through mentoring, strong cloud partnerships (Microsoft, ServiceNow, ..), local Training Center, certifications programs, unlimited access to Udemy Learning and our Power Skills Academy;
  • 🌍 Be part of something bigger. Work for a company that values social impact, sustainability, and digital inclusion. Our CSR strategy will empower your ideas through the Devoteam Fondation and its volunteering possibilities;  
  • 🤝 Team Diversity.  Join a team of 130 tech-enthusiasts from more than 25 diverse nationalities where togetherness & celebrating successes are paramount. 

Devoteam stands for equal opportunities. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All our positions are open to people with disabilities.

Lieu du poste

Similar Jobs

Landor - Creative Strategist

Landor

New York, United States (On-Site)
2 Months ago
Sika Group - Business Development Manager - Solar

Sika Group

Vadodara, Gujarat, India (On-Site)
2 Months ago
bytedance - Senior Software Engineer(Financing Product), Global Payments

bytedance

San Jose, California, United States (On-Site)
8 Months ago
GHX - Managed Service Analyst II

GHX

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
Maersk - People Partner

Maersk

Bangkok, Thailand (Hybrid)
1 Week ago
Pinterest - Senior Data Analyst

Pinterest

Chicago, Illinois, United States (Hybrid)
1 Week ago
Ziff Davis - Data Scientist

Ziff Davis

Dublin, County Dublin, Ireland (Remote)
2 Months ago
Frontier Developments - Experienced Data Analyst

Frontier Developments

Cambridge, England, United Kingdom (Hybrid)
4 Weeks ago
binance - Backend Engineer (Java + Big Data) - Trading Insights

binance

Taipei City, Taiwan (Remote)
11 Months ago
Saxo Bank - Product Governance and Data Analyst

Saxo Bank

Tokyo, Japan (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

belka games - Senior 2D Artist (RnD)

belka games

(Remote)
2 Months ago
Tellius - Data Scientist

Tellius

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Activate Games - Game Facilitator (Store Associate)

Activate Games

Tustin, California, United States (On-Site)
1 Month ago
Capgemini - Product, System & PLM Engineer

Capgemini

Pune, Maharashtra, India (On-Site)
1 Month ago
Ion - AI Engineer - Graduate Development Program

Ion

Pisa, Tuscany, Italy (On-Site)
9 Months ago
Thatch.ai  - Customer Success Manager, Small & Medium Business (SMB)

Thatch.ai

Austin, Texas, United States (Remote)
1 Week ago
Nice - Sales Development Representative

Nice

Sandy, Utah, United States (Hybrid)
3 Weeks ago
Inspiren - Clinical Success Manager

Inspiren

United States (Remote)
1 Week ago
stawdog studios - 2D / 3D Generalist Artist

stawdog studios

(On-Site)
1 Week ago
NBC Universal - Fleet Service Technician

NBC Universal

Doraville, Georgia, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Luxembourg, Luxembourg, Luxembourg

ARHS - Senior Penetration Tester / Security Engineer

ARHS

Luxembourg (On-Site)
1 Month ago
PwC - Manager / Senior Manager Corporate Tax Consulting (m/f/d)

PwC

Luxembourg (On-Site)
9 Months ago
ARHS - Business Analyst

ARHS

Luxembourg (On-Site)
1 Week ago
PwC - Senior Associate Tax Consulting

PwC

Luxembourg (On-Site)
1 Month ago
ARHS - AWS or Azure Cloud Architect

ARHS

Luxembourg (On-Site)
3 Months ago
ARHS - Senior Java Developer

ARHS

Luxembourg (On-Site)
9 Months ago
PwC - AI/ML Azure Engineer (m/f/d)

PwC

Luxembourg (On-Site)
9 Months ago
PwC - Manager Transfer Pricing

PwC

Luxembourg (On-Site)
1 Month ago
PwC - Senior Fund Accountant

PwC

Luxembourg (On-Site)
1 Month ago
ARHS - IT Java Architect

ARHS

Luxembourg (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Nagarro - Associate Principal Consultant, Business Analyst

Nagarro

Australia (Remote)
9 Months ago
binance - Data Scientist, LLM (AI Agent)

binance

Taipei City, Taiwan (Remote)
4 Weeks ago
Yahoo - Senior Data Engineer - Consumer Data AI / ML

Yahoo

United States (Hybrid)
1 Month ago
bytedance - Software Engineer - Data Engineering (Video Arch)

bytedance

Singapore (On-Site)
8 Months ago
Tide - Lead Data Scientist (Generative AI)

Tide

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Forescout Technologies  Inc  - Senior Data Scientist

Forescout Technologies Inc

Eindhoven, North Brabant, Netherlands (On-Site)
2 Months ago
Euromonitor - Data Platform Engineer II

Euromonitor

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Capgemini - Business Analyst

Capgemini

Mumbai, Maharashtra, India (On-Site)
2 Months ago
facepunch - Data Engineer

facepunch

(Remote)
2 Months ago
Next Level Business Services - Big Data Architect with IBM Big Insights

Next Level Business Services

St. Louis, Missouri, United States (Hybrid)
8 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Barcelona, Catalonia, Spain (Remote)

Barcelona, Catalonia, Spain (Hybrid)

Amman, Amman Governorate, Jordan (On-Site)

Amsterdam, North Holland, Netherlands (On-Site)

Barcelona, Catalonia, Spain (Hybrid)

Amsterdam, North Holland, Netherlands (On-Site)

Barcelona, Catalonia, Spain (Hybrid)

Aarhus, Denmark (On-Site)

View All Jobs

Get notified when new jobs are added by Devoteam

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug