Data Engineer (Apache Spark – Python/Scala)

2 Weeks ago • 2-5 Years • Data Analysis

Job Summary

Job Description

We are looking for a Data Engineer with solid experience in Big Data environments, particularly using Apache Spark. You will be involved in the design and implementation of robust data pipelines and storage solutions, supporting the data needs of business and technical stakeholders. Responsibilities include building and optimizing data pipelines with Apache Spark (Python and/or Scala), processing large-scale batch and streaming datasets, working with REST APIs, collaborating with data scientists and engineers, ensuring data quality, and contributing to CI/CD and automation best practices. The role requires organizing and managing data in on-prem object storage and promoting data governance awareness.
Must have:
  • Apache Spark (Python/Scala)
  • SQL
  • Data integration
  • Git, Airflow, CI/CD
  • REST APIs
  • Object storage (S3/MinIO)
  • Data governance awareness
  • Fluent in French and English (B2)
Good to have:
  • Experience in on-premises environments
  • Bachelor's/Master's in Computer Science/Engineering
Perks:
  • Informal hierarchy and work environment
  • Attractive salary package
  • Strong corporate culture
  • Learning & development opportunities
  • Exciting projects
  • Rock solid company

Job Details

Job Description

We are looking for a Data Engineer (m/f) with solid experience in Big Data environments, particularly using Apache Spark. You will be involved in the design and implementation of robust data pipelines and storage solutions, supporting the data needs of business and technical stakeholders.

Responsibilities:

  • Build and optimize data pipelines with Apache Spark (Python and/or Scala)
  • Process large-scale batch and streaming datasets
  • Work with REST APIs to retrieve and integrate external data
  • Collaborate with data scientists and engineers in Agile teams
  • Ensure data quality, testing, and monitoring
  • Contribute to CI/CD and automation best practices
  • Organize and manage data in on-prem object storage
  • Promote data governance awareness: data lineage, metadata, PII, data contracts…

Profile:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
  • 2 to 5 years of experience as a Data Engineer in Big Data environments
  • Strong skills in Apache Spark (Python and/or Scala), SQL, and data integration
  • Comfortable with Git, Airflow, and CI/CD pipelines
  • Experience with REST APIs and object storage (S3/MinIO)
  • Previous work in on-premises environments (not cloud-based) is appreciated
  • Awareness of data governance topics: data lineage, metadata, PII, data contracts…
  • Fluent in French and English (minimum B2 level)
  • Proactive, detail-oriented, and a strong communicator

Additional Information

Arηs Grouppart of Accenture - is a market leader in the management of complex IT projects and systems. Founded in Luxembourg in 2003, we have grown to encompass 11 entities worldwide, employing over 2,300 employees in Luxembourg, Belgium, Greece, Italy and Bulgaria.

With our focus on getting things done, we help our clients achieve their goals with best-of-breed solutions, superior execution and exceptional services. We offer bespoke software development, data science, infrastructure, digital trust and mobile development to government institutions at national and European level, telecom providers, and financial institutions, among others.

Our bold company culture is built around working hard and playing hard, with a flat and agile structure that lends itself to efficiency and employee empowerment. We value our diverse workplace of close-knit teams and provide a place where everyone can be supported to learn and evolve. 

 

Our Vision and Values

Our vision is to be the most caring and reliable IT company on the market place for both clients and our people.

Our values are: caring, agility, excellence, innovation, continual improvement, and reliability.

Our values support our vision by leveraging excellence, striving for results, ensuring commitment and promoting adaptability.

Our Culture

We work in close partnership with our customers, turning their needs into benefits; We promote a dynamic local environment where both young and experience people can realize themselves; We leverage a flexible, independent and responsive organization.

Our Brand

The ArȠs (pronounce [aris]) name comes from Greek Mythology. ArȠs is the son of Zeus and the God of War – in our eyes, an accurate representation of the intelligence, strategy, leadership and vision that are essential in business.

 

Don’t hesitate! Join our team

What you’ll get:

An informal hierarchy and work environment:

Our open, flat structure supports a strong focus on communication and collaboration, enabling to respond quickly to market changes and customer requests.

An attractive salary package:

With an attractive salary and benefits package – including advantageous fringe benefits – you’ll be paid for what you love to do.

A strong corporate culture:

You’ll join a dynamic team of smart and ambitious people. From the way we hire, to the way we relate to our clients – our values from the foundation of the way we work.

Learning & development opportunities:

We constantly invest in our people and are committed to providing individual development opportunities to help you continue to grow and stay happy and satisfied at work.

Exciting projects:

You’ll take ownership of various projects for both public and private clients: calling for creativity and innovation, at the cutting-edge of technology.

rock solid company:

With more than 200 customers by 2023, you’ll join a business with a sustainable and growth-oriented plan.

 

But let’s talk about it face to face!

 

You have the qualities as listed above? Please, apply & send us your CV, which will be processed in full confidentiality.

 

You don’t have all the above requirements but own a great part of them? You can send us your CV too because we will give you the opportunity to grow up with us.

Similar Jobs

GT HQ - Data Analyst

GT HQ

Ukraine (Remote)
1 Month ago
Autodesk - Solutions Engineer

Autodesk

Tokyo, Japan (On-Site)
2 Months ago
Social Discovery Group - Head of Product (Premium products)

Social Discovery Group

Almaty, Almaty Region, Kazakhstan (Remote)
8 Months ago
EXUSIA - AWS and Python Full Stack Leads / Senior Developers

EXUSIA

India (Remote)
6 Days ago
Mapbox - Senior Software Data Engineer , Basemap Team

Mapbox

Germany (Remote)
4 Days ago
Brillio - Data Scientist - R01551326

Brillio

Chennai, Tamil Nadu, India (Hybrid)
3 Weeks ago
Penn Interactive - Senior Data Analyst, Enterprise

Penn Interactive

Philadelphia, Pennsylvania, United States (Remote)
2 Days ago
Roblox - Senior Data Center Engineer

Roblox

Ashburn, Virginia, United States (On-Site)
6 Days ago
JDA - Sr. Data Scientist I (ML, Python, Tensorflow)

JDA

Bengaluru, Karnataka, India (On-Site)
2 Days ago
Next Level Business Services - Business Analyst - Mobility

Next Level Business Services

Collegeville, Pennsylvania, United States (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Rackspace Technology - Senior Tableau BI Engineer

Rackspace Technology

Egypt (Hybrid)
1 Month ago
Techland - TechQA Analyst

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
1 Month ago
Illumina - Staff Business System Analyst

Illumina

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Illumination - Jr. Executive Assistant

Illumination

Santa Monica, California, United States (On-Site)
4 Months ago
TransUnion - Lead Financial Services Consultant

TransUnion

White Plains, New York, United States (On-Site)
2 Months ago
NVIDIA - Senior System Validation Engineer

NVIDIA

Hanoi, Hanoi, Vietnam (On-Site)
4 Months ago
Apple - Data Engineer

Apple

Cupertino, California, United States (On-Site)
1 Month ago
luxsoft - Appian Developer

luxsoft

India (Remote)
3 Days ago
BigID - Regional Sales Manager

BigID

San Francisco, California, United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Luxembourg

PwC - Senior Fund Accountant

PwC

Luxembourg (On-Site)
1 Month ago
Square - Commercial Advisor

Square

Luxembourg (On-Site)
1 Week ago
PwC - AI/ML Azure Engineer (m/f/d)

PwC

Luxembourg (On-Site)
9 Months ago
HCL Tech - Avaloq Business Specialist

HCL Tech

Luxembourg (On-Site)
2 Months ago
ARHS - Medior DevOps Power BI Engineer

ARHS

Luxembourg (On-Site)
1 Week ago
ARHS - AWS or Azure Cloud Architect

ARHS

Luxembourg (On-Site)
3 Months ago
ARHS - Mid-level/Senior React Native Developer (m/f)

ARHS

Luxembourg (On-Site)
3 Weeks ago
PwC - AML/CFT Senior Manager

PwC

Luxembourg (On-Site)
1 Month ago
ARHS - DevOps Engineer

ARHS

Luxembourg (On-Site)
2 Months ago
PwC - Document Management Officer

PwC

Luxembourg (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Nagarro - Associate Staff Consultant, Business Analyst

Nagarro

Canada (Remote)
9 Months ago
paxie games - Data Scientist

paxie games

Istanbul, İstanbul, Türkiye (On-Site)
1 Month ago
Matific - Principal Data Engineer

Matific

Sri Lanka (On-Site)
6 Days ago
Brillio - Technical Business Analyst/Product Owner

Brillio

Edison, New Jersey, United States (Remote)
1 Month ago
techholding - Salesforce Business Analyst

techholding

New York, New York, United States (Hybrid)
2 Months ago
oportun - Senior Data Scientist

oportun

(Remote)
2 Months ago
Ziff Davis - Data Engineer II

Ziff Davis

United Kingdom (Remote)
2 Weeks ago
Playtika - Youda - Data Analyst

Playtika

Netherlands (Hybrid)
8 Months ago
beghou consulting - Cloud Data Engineer

beghou consulting

Durham, North Carolina, United States (Hybrid)
3 Months ago
Siemens  - Data Integrity Analyst

Siemens

Noida, Uttar Pradesh, India (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

We are a fully independent group of companies specialised in managing complex IT projects and systems. Arηs analyses complexity and delivers simplicity in order to improve our society through reliable, efficient IT Systems. Our vision is to be the most caring and reliable IT company on the marketplace for both our clients and our people. Our values are: caring, agility, excellence, innovation, continual improvement. Our values support our vision by leveraging excellence, striving for results, ensuring commitment and promoting adaptability. We work in close partnership with our customers, turning their needs into benefits; We promote a dynamic local environment where both young and experienced people can realize themselves; We believe in state-of-the-art technologies and bleeding-edge methods; We leverage a flexible, independent, and responsive organisation.

Luxembourg (On-Site)

Luxembourg (On-Site)

Athens, Greece (On-Site)

Luxembourg (On-Site)

Brussels, Brussels, Belgium (On-Site)

Athens, Greece (On-Site)

Luxembourg (On-Site)

View All Jobs

Get notified when new jobs are added by ARHS

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug