LEAD DATA ENGINEER

3 Hours ago β€’ 5 Years +

About the job

SummaryBy Outscal

Lead Data Engineer with 5+ years of experience in building ETL pipelines on Apache Spark, orchestration on Airflow, and proficiency in ClickHouse, SQL, and Python. Experience with S3 and AWS Glue is essential.

Our team values ​​an analytical approach to decision making. We accumulate a huge amount of data every day – game events, marketing metrics and much more, which, when carefully analyzed, helps us get valuable insights and improve our games. High quality and speed of processing of this data play a key role for us. And we are looking for an experienced Lead Data Engineer who will help us with this and will be able to take our work with data to the next level.

What we will trust you with

  • Development of an infrastructure for solving product analytics problems based on ClickHouse.
  • Building and supporting data processing pipelines on the Spark on Kubernetes stack (Scala and SQL API), Airflow, Clickhouse and Python.
  • Prioritize tasks for mini-team of data engineers.
  • Optimization of infrastructure (optimal selection of memory size, cores, disks, instance types) for data processing tasks.
  • Helping analysts build complex data processing pipelines in Airflow.
  • Organization of processes for systematic data collection from different sources using different protocols.

Our stack:

  • Orchestration - AirFlow v2.5.3
  • ETL - Spark v3.2.0, AWS Glue
  • Resource Management - Kubernetes
  • Storage - AWS S3
  • DB - ClickHouse, PostgreSQL, MySQL
  • Languages - Scala, Python, SQL
  • Data governance - DataHub
  • DQ - Deequ
  • CI CD - GitLab CI
  • Secret storage - Vault
  • BI - Tableau

What we expect from you

  • Experience as a Data Engineer or similar position for at least five years.
  • Ability to build ETL on Apache Spark.
  • Understanding of how to implement orchestration on Apache Airflow.
  • Knowledge of SQL and the ability to understand Python code.
  • Experience working with S3.
  • Experience in working with databases (ClickHouse - must have, PostgreSQL, MySQL) and query optimization.
  • Fluent Russian.

WHAT WE OFFER

  • An opportunity to contribute significantly to a globally successful project within a stable international company.
  • Relocation to Serbia, or Armenia, or another destination upon our mutual agreement.
  • Relocation program and assistance with paperwork for residence in countries where our offices are located.
  • Competitive salary, reviewed every 6 months based on market trends and your performance.
  • Flexible work setup: whether you prefer coming to the office, working from home, or a hybrid of the two, the choice is yours.
  • Flexible benefits: an annual $1000 to spend on perks, including health insurance, sports, therapy, education and language classes.
  • Full pay during sick leaves and personal leaves, in addition to 20 working days of vacation annually.

About The Company

Limassol, Cyprus (Remote)

Serbia (Remote)

Limassol, Cyprus (Remote)

Belgrade, Serbia (Remote)

Limassol, Cyprus (On-Site)

Belgrade, Serbia (Remote)

Belgrade, Serbia (Remote)

Belgrade, Serbia (Remote)

Limassol, Cyprus (Remote)

Belgrade, Serbia (On-Site)

View All Jobs

Similar Jobs

Netflix - Data Engineer (L5) - Content Production & Promotion

California, United States (On-Site)

Zynga - Data Engineer

Tel Aviv District, Israel (On-Site)

Warner Bros. Games - Staff Data Engineer- C360, Hyderabad

Telangana, India (Hybrid)

Warner Bros. Games - Data Engineer II - C360, Hyderabad

Telangana, India (Hybrid)

Nasdaq - Senior Data Engineer - Python

Metro Manila, Philippines (Hybrid)

Nasdaq - Senior Data Engineer - Python

Metro Manila, Philippines (Hybrid)

Warner Bros. Games - Senior Data Engineer - MLG, Hyderabad

Telangana, India (Hybrid)

HP - Data Engineer 3

Karnataka, India (On-Site)

workco - Data Engineer (Contract)

United States (Remote)

Similar Skill Jobs

King - Senior Business Analyst

England, United Kingdom (On-Site)

Aristocrat Gaming - Planning & Procurement Analyst

Nevada, United States (Hybrid)

The Walt Disney Company - Senior Creature Technical Director

British Columbia, Canada (On-Site)

The Walt Disney Company - Lead Creature Technical Director

British Columbia, Canada (On-Site)

DraftKings - Senior Data Science Engineer, Search

Massachusetts, United States (On-Site)

DraftKings - Senior Data Science Engineer, Personalization

Massachusetts, United States (On-Site)

umusic - Administrative Assistant

California, United States (On-Site)

Jobs in Belgrade, Serbia

Visa - Legal Manager, Serbia

Belgrade, Serbia (Hybrid)

Magic Media - Lead 3D Environment Artist

Vojvodina, Serbia (Remote)

Magic Media - Lead Generation Manager

Vojvodina, Serbia (Remote)

PwC - Consultant in Tax Compliance

Belgrade, Serbia (On-Site)

PwC - Senior Consultant in Tax Compliance

Belgrade, Serbia (On-Site)

Sperasoft - Game QA Engineer

Vojvodina, Serbia (On-Site)

PwC - Consultant in Tax Accounting

Belgrade, Serbia (On-Site)

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug