Data Engineer (Apache Spark – Python/Scala)

20 Hours ago • 2-5 Years

Job Summary

Job Description

As a Data Engineer, you will be responsible for designing and implementing robust data pipelines and storage solutions using Apache Spark. You will work on processing large-scale batch and streaming datasets, integrating external data using REST APIs, and collaborating with data scientists and other engineers in Agile teams. Key responsibilities include building and optimizing data pipelines, ensuring data quality, contributing to CI/CD and automation best practices, and promoting data governance. You will work in an on-premises environment.
Must have:
  • Experience with Apache Spark (Python and/or Scala).
  • Strong skills in SQL and data integration.
  • Comfortable with Git, Airflow, and CI/CD pipelines.
  • Experience with REST APIs and object storage.

Job Details

Job Description

We are looking for a Data Engineer (m/f) with solid experience in Big Data environments, particularly using Apache Spark. You will be involved in the design and implementation of robust data pipelines and storage solutions, supporting the data needs of business and technical stakeholders.

Responsibilities:

  • Build and optimize data pipelines with Apache Spark (Python and/or Scala)
  • Process large-scale batch and streaming datasets
  • Work with REST APIs to retrieve and integrate external data
  • Collaborate with data scientists and engineers in Agile teams
  • Ensure data quality, testing, and monitoring
  • Contribute to CI/CD and automation best practices
  • Organize and manage data in on-prem object storage
  • Promote data governance awareness: data lineage, metadata, PII, data contracts…

Profile:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
  • 2 to 5 years of experience as a Data Engineer in Big Data environments
  • Strong skills in Apache Spark (Python and/or Scala), SQL, and data integration
  • Comfortable with Git, Airflow, and CI/CD pipelines
  • Experience with REST APIs and object storage (S3/MinIO)
  • Previous work in on-premises environments (not cloud-based) is appreciated
  • Awareness of data governance topics: data lineage, metadata, PII, data contracts…
  • Fluent in French and English (minimum B2 level)
  • Proactive, detail-oriented, and a strong communicator

Additional Information

Arηs Grouppart of Accenture - is a market leader in the management of complex IT projects and systems. Founded in Luxembourg in 2003, we have grown to encompass 11 entities worldwide, employing over 2,300 employees in Luxembourg, Belgium, Greece, Italy and Bulgaria.

With our focus on getting things done, we help our clients achieve their goals with best-of-breed solutions, superior execution and exceptional services. We offer bespoke software development, data science, infrastructure, digital trust and mobile development to government institutions at national and European level, telecom providers, and financial institutions, among others.

Our bold company culture is built around working hard and playing hard, with a flat and agile structure that lends itself to efficiency and employee empowerment. We value our diverse workplace of close-knit teams and provide a place where everyone can be supported to learn and evolve. 

 

Our Vision and Values

Our vision is to be the most caring and reliable IT company on the market place for both clients and our people.

Our values are: caring, agility, excellence, innovation, continual improvement, and reliability.

Our values support our vision by leveraging excellence, striving for results, ensuring commitment and promoting adaptability.

Our Culture

We work in close partnership with our customers, turning their needs into benefits; We promote a dynamic local environment where both young and experience people can realize themselves; We leverage a flexible, independent and responsive organization.

Our Brand

The ArȠs (pronounce [aris]) name comes from Greek Mythology. ArȠs is the son of Zeus and the God of War – in our eyes, an accurate representation of the intelligence, strategy, leadership and vision that are essential in business.

 

Don’t hesitate! Join our team

What you’ll get:

An informal hierarchy and work environment:

Our open, flat structure supports a strong focus on communication and collaboration, enabling to respond quickly to market changes and customer requests.

An attractive salary package:

With an attractive salary and benefits package – including advantageous fringe benefits – you’ll be paid for what you love to do.

A strong corporate culture:

You’ll join a dynamic team of smart and ambitious people. From the way we hire, to the way we relate to our clients – our values from the foundation of the way we work.

Learning & development opportunities:

We constantly invest in our people and are committed to providing individual development opportunities to help you continue to grow and stay happy and satisfied at work.

Exciting projects:

You’ll take ownership of various projects for both public and private clients: calling for creativity and innovation, at the cutting-edge of technology.

rock solid company:

With more than 200 customers by 2023, you’ll join a business with a sustainable and growth-oriented plan.

 

But let’s talk about it face to face!

 

You have the qualities as listed above? Please, apply & send us your CV, which will be processed in full confidentiality.

 

You don’t have all the above requirements but own a great part of them? You can send us your CV too because we will give you the opportunity to grow up with us.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Luxembourg

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

We are a fully independent group of companies specialised in managing complex IT projects and systems. Arηs analyses complexity and delivers simplicity in order to improve our society through reliable, efficient IT Systems. Our vision is to be the most caring and reliable IT company on the marketplace for both our clients and our people. Our values are: caring, agility, excellence, innovation, continual improvement. Our values support our vision by leveraging excellence, striving for results, ensuring commitment and promoting adaptability.

Berlin, Berlin, Germany (Remote)

Athens, Greece (Remote)

Athens, Greece (Remote)

Luxembourg (On-Site)

Berlin, Berlin, Germany (On-Site)

Brussels, Brussels, Belgium (On-Site)

View All Jobs

Get notified when new jobs are added by ARHS

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug