Senior Data Engineer - Streaming Platform

5 Months ago • 2 Years +

Backend Development

Job Description

As a Senior Data Engineer at Voodoo, you'll design, implement, and optimize real-time data pipelines handling billions of events daily. This involves architecting data flows for bidstream data, auction logs, and user behavior, using technologies like Kafka, Flink, and Spark. You'll operate data infrastructure on Kubernetes, ensuring high-throughput, low-latency processing. Responsibilities include designing event schemas, implementing monitoring, collaborating with backend engineers, and mentoring other engineers. The role requires strong experience with stream processing frameworks and distributed systems. The team focuses on monetizing Voodoo's inventory directly with advertising partners using advanced tech in a real-time bidding environment.

Good To Have:

Stream-native analytics platforms (Druid, ClickHouse)
Frequency capping, fraud detection, pacing algorithms
Service mesh, auto-scaling, cost optimization
Open-source streaming/infra contributions

Must Have:

2+ years building real-time data pipelines
Proficiency with Flink/Spark Structured Streaming
Java/Scala/Python programming (distributed systems)
Experience with Kafka/Kinesis/Pulsar
Kubernetes experience (Helm, resource tuning)
Protobuf/Avro & schema evolution
CI/CD & Infrastructure-as-code
Strong debugging & building reliable systems

Add these skills to join the top 1% applicants for this job

java

algorithms

scala

ci-cd

helm

kubernetes

circleci

spark

service-mesh

aws

python

terraform

cost-optimization

retention-strategies

problem-solving

Founded in 2013, Voodoo is a tech company that creates mobile games and apps with a mission to entertain the world. Gathering 800 employees, 7 billion downloads, and over 200 million active users, Voodoo is the #3 mobile publisher worldwide in terms of downloads after Google and Meta. Our portfolio includes chart-topping games like Mob Control and Block Jam, alongside popular apps such as BeReal and Wizz.

Team

The Engineering & Data team builds innovative tech products and platforms to support the impressive growth of their gaming and consumer apps which allow Voodoo to stay at the forefront of the mobile industry.

Within the Data team, you’ll join the Ad-Network Team which is an autonomous squad of around 30 people. The team is composed of top-tier software engineers, infrastructure engineers, data engineers, mobile engineers, and data scientists (among which 3 Kaggle Masters). The goal of this team is to provide a way for Voodoo to monetize our inventory directly with advertising partners, and relies on advanced technological solutions to optimize advertising in a real-time bidding environment. It is a strategic topic with significant impact on the business.

This role can be done fully remote in any EMEA country.

Role

Design, implement, and optimize real-time data pipelines handling billions of events per day with strict SLAs.
Architect data flows for bidstream data, auction logs, impression tracking and user behavior data.
Build scalable and reliable event ingestion and processing systems using Kafka, Flink, Spark Structured Streaming, or similar technologies.
Operate data infrastructure on Kubernetes, managing deployments, autoscaling, resource limits, and high availability.
Collaborate with backend to integrate OpenRTB signals into our data platform in near real-time.
Ensure high-throughput, low-latency processing, and system resilience in our streaming infrastructure.
Design and manage event schemas (Avro, Protobuf), schema evolution strategies, and metadata tracking.
Implement observability, alerting, and performance monitoring for critical data services.
Contribute to decisions on data modeling and data retention strategies for real-time use cases.
Mentor other engineers and advocate for best practices in streaming architecture, reliability, and performance.
Continuously evaluate new tools, trends, and techniques to evolve our modern streaming stack.

Profile (Must have)

Extensive experience in data or backend engineering, with at least 2+ years building real-time data pipelines.
Proficiency with stream processing frameworks like Flink, Spark Structured Streaming, Beam, or similar.
Strong programming experience in Java, Scala, or Python, with a focus on distributed systems.
Deep understanding of event streaming and messaging platforms such as GCP Pub/Sub, AWS Kinesis, Apache Pulsar, or Kafka — including performance tuning, delivery guarantees, and schema management.
Solid experience operating data services in Kubernetes, including Helm, resource tuning, and service discovery.
Experience with Protobuf/Avro, and best practices around schema evolution in streaming environments.
Familiarity with CI/CD workflows and infrastructure-as-code (e.g., Terraform, ArgoCD, CircleCI).
Strong debugging skills and a bias for building reliable, self-healing systems.
Nice to have:
Knowledge of stream-native analytics platforms (e.g., Druid, ClickHouse, Pinot).
Understanding of frequency capping, fraud detection, and pacing algorithms.
Exposure to service mesh, auto-scaling, and cost optimization in containerized environments.
Contributions to open-source streaming or infra projects.

undefined