Senior Data Engineer (AdTech)

2 Days ago • 5 Years +

About the job

SummaryBy Outscal

Senior Data Engineer with 5+ years experience in building and maintaining data systems and machine learning models using Scala. Must have expertise in Apache Spark, Scala microservices, GCP Dataflow, and high-throughput systems.

Company Description

We’re seeking a Data Engineer to build and maintain our data systems and machine learning models, using Scala to support and enhance our products. 

We have primed ourselves since day one to build one of the most resilient and scalable systems to support what we saw as one of the most interesting challenges in our careers. Our system currently processes TBs/s of data with upwards of 2 million writes per second - and as we grow, those numbers are expected to grow with us. 

We have also built our infrastructure and systems to allow innovation. If you have an idea to implement, or new technology to try out, this is the right place for you. 

As a Data Engineer, you will be working on our core systems, engines, and product services using the most sophisticated cutting-edge technologies to solve challenging problems that are unique to the DEI world. 

Job Description

  • Work with Apache Spark batch & real-time streaming to process data at scale 
  • Work with Scala microservices hosted on K8s (GKE) to support our products 
  • Work with MlLib and TensorFlow on Vertex AI to solve forecasting and simulations in addition to a variety of machine learning challenges 
  • Deploy new models and engines for new ideas and analyses 

 

Qualifications

  • 5+ years of experience 
  • Advanced knowledge of different non-relational schema models (Column Family, Graph, Document, Object) 
  • Experience with advanced topologies and architecture design such as KAPPA and LAMBDA architectures 
  • GCP Dataflow experience
  • Experience in Scala  
  • Experience in Python or Java 
  • Experience with high throughput systems 
  • Strong communication skills and at least a C1 level of English 

Additional Information

 

 

Masovian Voivodeship, Poland (Remote)

State Of São Paulo, Brazil (Remote)

Lviv Oblast, Ukraine (Remote)

Lesser Poland Voivodeship, Poland (Remote)

Federal District, Brazil (Remote)

Masovian Voivodeship, Poland (Remote)

Masovian Voivodeship, Poland (Remote)

Masovian Voivodeship, Poland (Remote)

View All Jobs

Similar Jobs

Warner Bros. Games - Staff Data Engineer- C360, Hyderabad

Telangana, India (Hybrid)

Warner Bros. Games - Data Engineer II - C360, Hyderabad

Telangana, India (Hybrid)

Nasdaq - Senior Data Engineer - Python

Metro Manila, Philippines (Hybrid)

Nasdaq - Senior Data Engineer - Python

Metro Manila, Philippines (Hybrid)

Warner Bros. Games - Senior Data Engineer - MLG, Hyderabad

Telangana, India (Hybrid)

HP - Data Engineer 3

Karnataka, India (On-Site)

workco - Data Engineer (Contract)

United States (Remote)

Riot Games - Data Engineer II - Data & Analytics

California, United States (On-Site)

NBC universal - Staff Data Engineer

New Jersey, United States (Remote)

Similar Skill Jobs

Activision - Senior Manager, Analytics Insights

California, United States (On-Site)

The Walt Disney Company - Senior Compositor

British Columbia, Canada (Hybrid)

DraftKings - Product Manager II

Massachusetts, United States (On-Site)

DraftKings - Product Manager I, Basketball

Massachusetts, United States (On-Site)

umusic - Representative, eCommerce Fan Services

Pennsylvania, United States (On-Site)

umusic - Senior BI Engineer

Pennsylvania, United States (On-Site)

Tencent - Senior Staff Researcher

California, United States (On-Site)

Trek - Service Manager

Florida, United States (On-Site)

umusic - Senior Director, Artist Liaison (Republic)

New York, United States (On-Site)

Scientific Games  - Senior Accountant

Karnataka, India (On-Site)

Jobs in Warsaw, Masovian Voivodeship, Poland

Aristocrat Gaming - Front End Developer

Masovian Voivodeship, Poland (Hybrid)

Testronic - Community Manager

Masovian Voivodeship, Poland (On-Site)

VGW - Software Engineer

Masovian Voivodeship, Poland (Remote)

Techland - Junior Lawyer

Masovian Voivodeship, Poland (On-Site)

CD PROJEKT RED - Music Director

Masovian Voivodeship, Poland (On-Site)

Activision - Lead Network Programmer

Masovian Voivodeship, Poland (On-Site)

Aristocrat Gaming - QA Manual (Pasino)

Masovian Voivodeship, Poland (Hybrid)

Aristocrat Gaming - QA Manual (Pasino)

Lesser Poland Voivodeship, Poland (Hybrid)

Ubisoft - Office Administrator (Part-Time)

Masovian Voivodeship, Poland (On-Site)

CD PROJEKT RED - Senior Previz Artist

Masovian Voivodeship, Poland (Hybrid)

Software Engineering Jobs

DraftKings - Senior Associate Delivery Manager

United States (Remote)

umusic - Senior BI Engineer

Pennsylvania, United States (On-Site)

Tencent - Senior Staff Researcher

California, United States (On-Site)

Aristocrat Gaming - Technical Lead - Full Stack Development

Uttar Pradesh, India (Hybrid)

Aristocrat Gaming - Front End Developer

Masovian Voivodeship, Poland (Hybrid)

DraftKings - Operations Specialist

Plovdiv Province, Bulgaria (Hybrid)

DraftKings - Senior AML Associate

United States (Remote)

DraftKings - Manager, Fantasy Sports Operations

Massachusetts, United States (On-Site)

Scientific Games  - Senior Accountant

Karnataka, India (On-Site)

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug