Community

Home >

Jobs >

Senior Big Data Engineer

Senior Big Data Engineer

2 Months ago • 5 Years + • Data Analyst • Undisclosed

About the job

10 skills required for this role

Add these skills to join the top 1% applicants for this job

ci-cd

pandas

teamcity

aws

python

sql

hadoop

postgresql

scalability

quality-control

Job Description

Playrix, a top mobile game developer, seeks a Senior Big Data Engineer to manage and optimize their vast data lake. You'll automate data extraction, quality control, and transformation processes, ensuring data reliability for game analytics and marketing. Expertise in Python, SQL, PySpark, Airflow, and cloud infrastructure is essential.

Must have:

5+ years Data Engineering
3+ years Python Dev
PySpark, Airflow
SQL query optimization

Good to have:

MLflow experience
Experience with DBT
Serverless approach
TeamCity knowledge

Perks:

Flexible work schedule
Health insurance

Senior Big Data Engineer (Core Data)

About the company

Playrix is one of the most successful mobile game development companies  in the world. In terms of mobile application revenue, we rank first in Europe  and are in the top 3 worldwide. Our games have been installed 2.3 billion times (that's a third of the world's population!) and more than 30 million people around the world play them every day.

Team, about the role

Our data lake contains over 2.5 petabytes of marketing metrics, game events, and operational parameters. We do everything possible to ensure there's no doubt about the completeness, relevance, and reliability of the data we provide. We pay special attention to processing speed and data quality. This allows us to make the right decisions when developing our games.

We want to boost the gaming and marketing event attribution business and are looking for a Senior Data Engineer to join our Data Core team, which is responsible for organizing the storage, transformation and access to gaming and marketing analytics data.

Tasks

Automating external source data extraction processes
Automating quality control and verification of supplied data, configuring monitoring and regulations
Transforming and uploading data for further analysis within game analytics and marketing in the most client-friendly form
Developing and maintaining a continuous data delivery pipeline
Developing and maintaining the integration services for interaction with partners

Our stack

Python is our main language, and data access is in SQL. Our Data Lake is built on the S3 and Delta Lake format in Databricks. For our DWH, we use Redshift/PostgreSQL. We work in the AWS cloud infrastructure.

We use solutions from mainstream vendors, including MonteCarlo and DBT. We use a serverless approach when working with resources, as well as horizontal scaling and predictive models. We pay close attention to both code and architecture refactoring. For CI/CD, we use TeamCity.

Requirements

5+ years of general experience in Data Engineering

3+ years of development experience in Python: OOP, skills in designing frameworks and libraries, ability to read and analyze code, experience in profiling and performance/scalability optimization

Skills in working with popular DE/ML frameworks: PySpark, Airflow, pandas, SQLAlchemy, MLflow

Skills in writing and optimizing SQL queries, ability to work with query plans, and experience working with repositories of different architectures: MPP, columnar, relation, Hadoop, in-memory
Experience with storage of different architectures like mpp, columnar, relation, hadoop, and in-memory
Fluency in Russian

Our Perks

Flexibility at work

For most positions we offer a flexible schedule, and employees can work from anywhere in the world (except for the Russian Federation and the Republic of Belarus). You can do your work however and wherever you like — we only evaluate your results.

Caring for health and well-being

We provide voluntary health insurance for employees and their children, and reimburse online sessions with a psychologist.
We offer fully paid vacation days and sick leave. In certain circumstances, you can request additional days off.
We support leading a healthy lifestyle and reimburse the cost of gym memberships and fitness app subscriptions.

Professional development and education

We pay for participation in specialized conferences and courses and hold our own internal conferences.
We offer discounts on English language courses and courses for the languages of the countries in which the company operates.

Events and merch

We regularly hold offline events like team meetings, big corporate parties, and informal office parties.
We also regularly organize fun competitions, quizzes, hackathons, and online fitness challenges.
We have a merch store with an internal currency you can use to buy unique gifts. We give out this currency as a gift for significant dates, and you can earn more by participating in events and company activities.

Share this job

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%