Big Data Engineer

5 Days ago • All levels • Data Analyst

Job Summary

Job Description

As a Big Data Engineer, you will join a team using cutting-edge technologies to collate real-time data from various sources within GiG. You'll support an event-driven microservice lambda architecture, working with an agile team to maintain and enhance a platform ingesting 5000+ messages/second across Lottery, Sports, and Casino products. Responsibilities include data modeling, ETL processes (in-memory data transfer), working with Apache Spark or Apache NiFi, and contributing to CI/CD processes for dockerized applications. Collaboration with Business Intelligence, Data Science, and QA teams is crucial. Reporting to the Lead Big Data Engineer, you'll follow best practices guided by the Big Data Architect.
Must have:
  • Object-oriented programming (Java)
  • Data modeling
  • ETL processes (in-memory)
  • Apache Spark or Apache NiFi
  • CI/CD
  • Docker
  • Distributed version control
  • Excellent teamwork
Good to have:
  • Functional programming (Python, Scala)
  • Analytical mindset
  • Low-latency databases (ClickHouse)
  • Bachelor's in Computer Science
  • Scoping collaboration
  • Mentoring
  • Linux/Windows experience
Perks:
  • Great career development
  • 100% remote or hybrid work
  • International health insurance
  • Health & wellbeing package (350 EUR/year)
  • Birthday day off
  • Me time (1 day off/year)
  • Free lunches

Job Details

Description

As part of the Big Data Team, you will be using cutting edge technologies to work on collating data across different sources within GiG. Sources are all in real time, and you will be supporting an event driven micro service lambda architecture.

Your focus is to work with the current agile team and contribute to the platform’s objectives and continue being an enabler to many other data technology stakeholders such as the Business Intelligence, Data Science and Quality Assurance teams. You will be up for a challenge, to continue maintaining and adding new features to a platform that ingests up to 5000 messages per second across multiple products such as Lottery, Sports and Casino.

Reporting to the Lead Big Data Engineer and supported by the Big Data Architect to follow best practices, you’ll be guided into delivering world class product increments that support our Tier 1 Platform.

You’re really awesome at:

  • Object oriented programming (Java)
  • Data modelling using any database technologies
  • ETL processes (ETLs are oldschool, we transfer in memory now) and experience with Apache Spark or Apache NiFi
  • Applied understanding of CI\CD in change management
  • Dockerised applications
  • Used distributed version control systems
  • Excellent team player
  • Meticulous and passionate about your work

You’re also good at:

  • Functional oriented programming (experience with Python, Scala)
  • Analytical mindset
  • Low latency databases such as ClickHouse
  • Hold a Bachelor’s Degree in Computer Science or equivalent
  • Can collaborate in scoping exercises
  • Mentoring skills
  • Have worked with both Linux and Windows environments.
  • Unix/Linux

What will you get in this role?

You’ll give us your ideas and knowledge, and if we’re a good match we’ll back you up with a salary you can be proud of and amazing industry perks like daily lunch. On top of the perks, you’ll even get to work with the best talent the industry has to offer.

Benefits:

  • Great career development opportunities
  • 100% remote or hybrid working model
  • International Health Insurance
  • Health and Wellbeing Package (350 EUR per year)
  • Birthday Day Off
  • Me Time - 1 day off per year
  • Lunches in the office for free

Benefits

  • Great career development opportunities
  • Hybrid or remote working model
  • International Health Insurance
  • Health and Wellbeing Package (350 EUR per year)
  • Birthday Day Off
  • Me Time - 1 day off per year

Similar Jobs

ByteDance - Client Engineer (Real Time Communication) - 2025 Start

ByteDance

Singapore (On-Site)
5 Months ago
Reliance Industries  - Manual Do QA

Reliance Industries

Bengaluru, Karnataka, India (On-Site)
4 Months ago
ByteDance - Algorithm Engineer - Enterprise Solution R&D

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Warner Bros Games - Senior Software Engineer - Python - Backend Developer

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
GoTo Group - Lead Software Engineer - Engineering Platforms

GoTo Group

Bengaluru, Karnataka, India (On-Site)
4 Months ago
N-iX - Senior Data Engineer

N-iX

Poland (Hybrid)
1 Month ago
Inwave - R&D Specialist

Inwave

(On-Site)
1 Month ago
Behaviour Interactive - Senior Data Developer - Dead by Daylight

Behaviour Interactive

Montreal, Quebec, Canada (Hybrid)
3 Weeks ago
PwC - IN-Senior Associate _.Net Developer _Data & Analytics _Advisory _PAN India

PwC

Kolkata, West Bengal, India (On-Site)
5 Months ago
Onward Search - Digital Music Data Analyst

Onward Search

Cupertino, California, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Playrix - Director of Engineering

Playrix

Portugal (Remote)
5 Months ago
Canva - Backend Software Engineer (Java) - Global Payments

Canva

Sydney, New South Wales, Australia (Remote)
3 Weeks ago
ION - Senior DevSecOps Engineer, Italy

ION

Milan, Lombardy, Italy (On-Site)
5 Months ago
Red Point Labs - Java Backend Developer (Remote OK)

Red Point Labs

Argentina (Remote)
10 Months ago
Nielsen Holdings - Senior Software Engineer - Bigdata ( Java / Scala / Python , Spark, SQL , AWS)

Nielsen Holdings

Mumbai, Maharashtra, India (Hybrid)
5 Months ago
PwC - Senior Associate_Android/Flutter Developer_Data & Analytics_Advisory_PAN India

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Scopely - Software Engineer (Java)

Scopely

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Google - Software Engineering Manager, Black Community Inclusion

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
4 Months ago
Highspot - Sr. Full Stack Engineer, Training & Coaching

Highspot

Hyderabad, Telangana, India (Hybrid)
5 Months ago
ION - Technical Support Analyst, Chicago - 5849/9555

ION

Chicago, Illinois, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Community of Madrid, Spain

Gaming Innovation Group  - Infrastructure Engineer

Gaming Innovation Group

Community Of Madrid, Spain (Hybrid)
6 Days ago
Aristocrat Gaming - Game Design Director

Aristocrat Gaming

Barcelona, Catalonia, Spain (Hybrid)
4 Days ago
Gaming Innovation Group  - Product Owner - Front-End

Gaming Innovation Group

Andalusia, Spain (Hybrid)
6 Days ago
Gaming Innovation Group  - Database Engineer (MySQL)

Gaming Innovation Group

Catalonia, Spain (Hybrid)
5 Days ago
Global Step - Director of Sales

Global Step

Spain (On-Site)
5 Months ago
Scopely - Senior Engineer - Monopoly GO!

Scopely

Seville, Andalusia, Spain (Hybrid)
5 Months ago
Voodoo - Senior Multiplayer Server Developer - Paper.io 2

Voodoo

Barcelona, Catalonia, Spain (Remote)
1 Month ago
FitXR - Senior Product Manager

FitXR

Spain (Remote)
6 Days ago
El Ranchito - VFX Production Coordinator

El Ranchito

Madrid, Community Of Madrid, Spain (On-Site)
8 Months ago
Electronic Arts - Videogame Tester - Dutch

Electronic Arts

Madrid, Community Of Madrid, Spain (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

N-iX - Middle HPC Data Engineer

N-iX

Argentina (Remote)
1 Week ago
Netflix - Data Scientist (L4) - Content DSE

Netflix

Los Angeles, California, United States (On-Site)
5 Months ago
Dream11 - Lead ML Scientist

Dream11

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Ciklum - Senior Data Scientist

Ciklum

Chennai, Tamil Nadu, India (Hybrid)
5 Months ago
DraftKings - Senior Data Science Engineer, Personalization

DraftKings

Boston, Massachusetts, United States (On-Site)
3 Months ago
Ubisoft - Financial Analyst Assistant Internship

Ubisoft

Paris, Île-de-France, France (On-Site)
6 Days ago
Interactive Brokers - Data Engineer

Interactive Brokers

Budapest, Hungary (Hybrid)
5 Months ago
Warner Bros Games - Senior Manager, Analytics Engineering

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
2 Months ago
InMobiInMobi - Senior Associate, Rewards

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
2 Months ago
InMobiInMobi - Lead, Consumer Insights

InMobiInMobi

New York, New York, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

We are an award-winning iGaming platform and sportsbook provider supplying industry-leading solutions to our partners and their players. We specialise in helping online and land-based operators expand their iGaming and sports betting business on a global scale, focusing on innovation and customisation to power localised customer experiences and intimate user journeys. As a regulated markets specialist, we offer compliant entry into 36+ complex regulated markets around the world.


Our powerful iGaming platform is built to be scalable, open and user-centric, rapidly integrating with our partners' existing tech and preferred third parties. It provides a personalised user experience through our suite of real-time marketing tools, real-time data, and real-time rules engine, allowing our partners to build their own automated bespoke rules, without the need for coding knowledge.


Our sportsbook is built mobile-first and provides a premium player experience through our Bet builder, comprehensive Live betting capabilities and Player props. Our partners benefit from tailored odds, personalised margins, and risk management strategy, increasing the players’ personalised experience. Our partners benefit from an in-house trading team available 24/7 through direct communication channels, delivering unparalleled agility and service to all our partners, around the clock.


General enquiries: sales@gig.com

St. Julian's, Malta (Hybrid)

Community Of Madrid, Spain (Hybrid)

Catalonia, Spain (Hybrid)

Andalusia, Spain (Hybrid)

Community Of Madrid, Spain (Hybrid)

Community Of Madrid, Spain (Hybrid)

Community Of Madrid, Spain (Hybrid)

Catalonia, Spain (Hybrid)

Andalusia, Spain (Hybrid)

Catalonia, Spain (Hybrid)

View All Jobs

Get notified when new jobs are added by Gaming Innovation Group

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug