Data Engineer (Apache Spark – Python/Scala)

1 Month ago • 2-5 Years • Data Analysis

Job Summary

Job Description

As a Data Engineer, you will be responsible for designing and implementing robust data pipelines and storage solutions using Apache Spark. You will work on processing large-scale batch and streaming datasets, integrating external data using REST APIs, and collaborating with data scientists and other engineers in Agile teams. Key responsibilities include building and optimizing data pipelines, ensuring data quality, contributing to CI/CD and automation best practices, and promoting data governance. You will work in an on-premises environment.
Must have:
  • Experience with Apache Spark (Python and/or Scala).
  • Strong skills in SQL and data integration.
  • Comfortable with Git, Airflow, and CI/CD pipelines.
  • Experience with REST APIs and object storage.

Job Details

Job Description

We are looking for a Data Engineer (m/f) with solid experience in Big Data environments, particularly using Apache Spark. You will be involved in the design and implementation of robust data pipelines and storage solutions, supporting the data needs of business and technical stakeholders.

Responsibilities:

  • Build and optimize data pipelines with Apache Spark (Python and/or Scala)
  • Process large-scale batch and streaming datasets
  • Work with REST APIs to retrieve and integrate external data
  • Collaborate with data scientists and engineers in Agile teams
  • Ensure data quality, testing, and monitoring
  • Contribute to CI/CD and automation best practices
  • Organize and manage data in on-prem object storage
  • Promote data governance awareness: data lineage, metadata, PII, data contracts…

Profile:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
  • 2 to 5 years of experience as a Data Engineer in Big Data environments
  • Strong skills in Apache Spark (Python and/or Scala), SQL, and data integration
  • Comfortable with Git, Airflow, and CI/CD pipelines
  • Experience with REST APIs and object storage (S3/MinIO)
  • Previous work in on-premises environments (not cloud-based) is appreciated
  • Awareness of data governance topics: data lineage, metadata, PII, data contracts…
  • Fluent in French and English (minimum B2 level)
  • Proactive, detail-oriented, and a strong communicator

Additional Information

Arηs Grouppart of Accenture - is a market leader in the management of complex IT projects and systems. Founded in Luxembourg in 2003, we have grown to encompass 11 entities worldwide, employing over 2,300 employees in Luxembourg, Belgium, Greece, Italy and Bulgaria.

With our focus on getting things done, we help our clients achieve their goals with best-of-breed solutions, superior execution and exceptional services. We offer bespoke software development, data science, infrastructure, digital trust and mobile development to government institutions at national and European level, telecom providers, and financial institutions, among others.

Our bold company culture is built around working hard and playing hard, with a flat and agile structure that lends itself to efficiency and employee empowerment. We value our diverse workplace of close-knit teams and provide a place where everyone can be supported to learn and evolve. 

 

Our Vision and Values

Our vision is to be the most caring and reliable IT company on the market place for both clients and our people.

Our values are: caring, agility, excellence, innovation, continual improvement, and reliability.

Our values support our vision by leveraging excellence, striving for results, ensuring commitment and promoting adaptability.

Our Culture

We work in close partnership with our customers, turning their needs into benefits; We promote a dynamic local environment where both young and experience people can realize themselves; We leverage a flexible, independent and responsive organization.

Our Brand

The ArȠs (pronounce [aris]) name comes from Greek Mythology. ArȠs is the son of Zeus and the God of War – in our eyes, an accurate representation of the intelligence, strategy, leadership and vision that are essential in business.

 

Don’t hesitate! Join our team

What you’ll get:

An informal hierarchy and work environment:

Our open, flat structure supports a strong focus on communication and collaboration, enabling to respond quickly to market changes and customer requests.

An attractive salary package:

With an attractive salary and benefits package – including advantageous fringe benefits – you’ll be paid for what you love to do.

A strong corporate culture:

You’ll join a dynamic team of smart and ambitious people. From the way we hire, to the way we relate to our clients – our values from the foundation of the way we work.

Learning & development opportunities:

We constantly invest in our people and are committed to providing individual development opportunities to help you continue to grow and stay happy and satisfied at work.

Exciting projects:

You’ll take ownership of various projects for both public and private clients: calling for creativity and innovation, at the cutting-edge of technology.

rock solid company:

With more than 200 customers by 2023, you’ll join a business with a sustainable and growth-oriented plan.

 

But let’s talk about it face to face!

 

You have the qualities as listed above? Please, apply & send us your CV, which will be processed in full confidentiality.

 

You don’t have all the above requirements but own a great part of them? You can send us your CV too because we will give you the opportunity to grow up with us.

Similar Jobs

whoop - Senior Hardware Quality Engineer (NPI)

whoop

Boston, Massachusetts, United States (On-Site)
4 Weeks ago
PwC - Senior Associate - Oracle EPM Advisory

PwC

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Sumo logic - Staff QE Software Engineer

Sumo logic

Bengaluru, Karnataka, India (Remote)
1 Month ago
Tesla - Data Analytics Internship

Tesla

Tilburg, North Brabant, Netherlands (On-Site)
4 Months ago
Simple Viral Games - Fullstack Developer Intern

Simple Viral Games

Bengaluru, Karnataka, India (On-Site)
11 Months ago
binance - Big Data Engineer (Spark, Flink, Java)

binance

Asia, Lima Region, Peru (Remote)
2 Years ago
luxsoft - Senior Murex FO Technical Business Analyst

luxsoft

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Guardian - Disability Business Systems Analyst

Guardian

Pittsfield, Massachusetts, United States (Hybrid)
1 Month ago
bytedance - Site Reliability Engineer - Data Infrastructure (Seattle)

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

playrix  - Senior Data Analyst (Attribution)

playrix

Cyprus (Remote)
8 Months ago
Toast - Senior Manager, Finance Systems & Operations

Toast

New York, United States (On-Site)
1 Month ago
Scientific Games - Director, Product Management

Scientific Games

Alpharetta, Georgia, United States (On-Site)
2 Months ago
PayPal - Product Manager

PayPal

San Jose, California, United States (Hybrid)
2 Weeks ago
Stibo Systems - Director, AI Center of Excellence

Stibo Systems

Aarhus, Denmark (Hybrid)
1 Month ago
Zynga - Senior Data Analyst - Consumer Insights

Zynga

Austin, Texas, United States (On-Site)
1 Month ago
Synechron - Senior Murex Batch Support Engineer

Synechron

Pune, Maharashtra, India (On-Site)
1 Month ago
Tekion Corp - Senior Product Manager - Analytics

Tekion Corp

United States (On-Site)
1 Month ago
Alpha Sense - Senior Product Designer

Alpha Sense

Chicago, Illinois, United States (On-Site)
1 Month ago
Devoteam - Coordinator / Systems Administrator N2

Devoteam

Barcelona, Catalonia, Spain (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Luxembourg

RTL - Calendar and events

RTL

Luxembourg (On-Site)
1 Week ago
ARHS - Senior Java Jee Developer

ARHS

Luxembourg (On-Site)
8 Months ago
PayPal - CFO

PayPal

Luxembourg, Luxembourg, Luxembourg (Hybrid)
4 Weeks ago
ARHS - Functional Support Analyst

ARHS

Luxembourg (On-Site)
6 Days ago
PwC - Strategy& Luxembourg Financial Services - Manager (m/f/d)

PwC

Luxembourg (On-Site)
6 Months ago
ARHS - DevOps Engineer

ARHS

Luxembourg (On-Site)
1 Month ago
PwC - Manager Transfer Pricing

PwC

Luxembourg (On-Site)
3 Weeks ago
Betson Group - Paralegal

Betson Group

Luxembourg (On-Site)
1 Month ago
ARHS - Sales Support Officer

ARHS

Luxembourg (On-Site)
1 Week ago
ARHS - AWS Cloud Architect

ARHS

Luxembourg (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Illumina - Staff Business Process Analyst, Source to Pay Process Excellence (SAP)

Illumina

San Diego, California, United States (On-Site)
1 Month ago
Capco - Business Analyst

Capco

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago
attentive - Senior Data Scientist/Applied Scientist, AI Products

attentive

New York, United States (Hybrid)
1 Year ago
Roof Stacks - Senior Business Analyst (Digital Participation Banking)

Roof Stacks

Istanbul, İstanbul, Türkiye (Hybrid)
5 Months ago
Pulse Point - Data Engineer, ML/Data Science

Pulse Point

Navi Mumbai, Maharashtra, India (Remote)
1 Month ago
Sigma Software - Data Engineer

Sigma Software

Lviv, Lviv Oblast, Ukraine (On-Site)
8 Months ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
5 Months ago
London stock Exchange - Fixed Income Data Analyst

London stock Exchange

Buffalo, New York, United States (On-Site)
2 Weeks ago
Guardian - Disability Business Systems Analyst

Guardian

Pittsfield, Massachusetts, United States (Hybrid)
1 Month ago
Autodesk - Software Architect, AEC Data

Autodesk

Montreal, Quebec, Canada (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

We are a fully independent group of companies specialised in managing complex IT projects and systems. Arηs analyses complexity and delivers simplicity in order to improve our society through reliable, efficient IT Systems. Our vision is to be the most caring and reliable IT company on the marketplace for both our clients and our people. Our values are: caring, agility, excellence, innovation, continual improvement. Our values support our vision by leveraging excellence, striving for results, ensuring commitment and promoting adaptability. We work in close partnership with our customers, turning their needs into benefits; We promote a dynamic local environment where both young and experienced people can realize themselves; We believe in state-of-the-art technologies and bleeding-edge methods; We leverage a flexible, independent, and responsive organisation.

Brussels, Brussels, Belgium (On-Site)

Brussels, Brussels, Belgium (On-Site)

Brussels, Brussels, Belgium (On-Site)

The Hague, South Holland, Netherlands (Remote)

Luxembourg (On-Site)

Luxembourg (On-Site)

Luxembourg (On-Site)

Brussels, Brussels, Belgium (On-Site)

View All Jobs

Get notified when new jobs are added by ARHS

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug