Senior Data Engineer

4 Months ago • 6 Years + • $121,400 PA - $161,800 PA

Job Summary

Job Description

Rockstar Games seeks a Senior Data Engineer to build a cutting-edge game analytics platform. Responsibilities include implementing and maintaining real-time and batch data models, designing and optimizing data architecture, delivering data models to analysts and data scientists, assisting in deployment automation, developing a big data platform using Databricks, Spark, and Airflow, setting warehouse and schema design standards, identifying process improvements, maintaining CI/CD processes, and providing technical guidance. The ideal candidate has 6+ years of experience with data pipeline development in a major cloud platform, 4+ years with Python and Spark, and expertise in SQL and massively parallel processing. The role requires building real-time data pipelines and managing data warehouses at scale.
Must have:
  • 6+ years data pipeline design experience
  • 4+ years Python & Spark experience
  • SQL expertise
  • Big data & cloud architecture understanding
  • Real-time data pipeline experience
  • Data warehouse experience (terabyte/petabyte scale)
Good to have:
  • Databricks experience
  • Experience with Data warehouses
  • Kubernetes/AKS experience
  • Java or Scala experience
  • Jupyter Notebooks experience
  • Lambda data ingestion architecture
  • CI/CD experience
  • Restful APIs familiarity
  • Artifact Repositories experience
  • Machine Learning pipeline experience

Job Details

At Rockstar Games, we create world-class entertainment experiences. 

Become part of a team working on some of the most rewarding, large-scale creative projects to be found in any entertainment medium - all within an inclusive, highly-motivated environment where you can learn and collaborate with some of the most talented people in the industry.  

Rockstar is seeking a Senior Data Engineer to join a team focused on building a cutting-edge game analytics platform and tools to better understand our players and enhance their experience in our games.  

The ideal candidate will be skilled in developing complex ingestion and transformation processes with an emphasis on reliability and performance. In collaboration with other Data Engineers, Machine Learning Engineers, and Software Engineers, the candidate will empower the team of Analysts and Data Scientists to deliver data driven insights and applications to company stakeholders. 

This is a full-time, in-office position based out of Rockstar’s NYC headquarters in Downtown Manhattan.  

WHAT WE DO  

  • The Rockstar Analytics team provides insights and actionable results to a wide variety of stakeholders across the organization in support of their decision making.  

RESPONSIBILITIES  

  • Implement and maintain real-time and batch Data Models. 
  • Play a key role in designing and optimizing the overall data architecture, ensuring scalability, reliability, and performance. 
  • Deliver real-time and non-real-time data models to Analysts and Data Scientists who create insights and applications for our stakeholders. 
  • Assist in the development of deployment automation and operational support strategies. 
  • Assist in the development of a big data platform in Databricks using pipeline technologies such as Spark, Airflow, and more to support a variety of requirements and applications. 
  • Set the standards for warehouse and schema design in massively parallel processing engines such as Databricks (Spark) and Snowflake while collaborating with Analysts and Data Scientists in the creation of efficient data models. 
  • Identify opportunities for process improvement and best practices in data engineering and contribute to the development and implementation of new methodologies. 
  • Maintain and extend our CI/CD processes and documentation. 
  • Provide technical guidance and leadership to the Data Engineering team, including mentoring junior Engineers. 

QUALIFICATIONS  

  • 6+ years of work experience with designing and development of modern data pipelines within a major cloud platform (GCP, AWS, Azure). 
  • 4+ years of experience with Python (or a comparable scripting language).  
  • 4+ years of experience with Spark.  
  • 2+ years of experience with query optimization, data structures, transformation, metadata, dependency, and workload management. 
  • Expert in at least one SQL language.  
  • Experience developing and managing data warehouses on a terabyte or petabyte scale. 
  • Strong experience in massively parallel processing. 
  • Experience building Real-Time and/or Near-Real-Time data pipelines. 
  • Good Understanding of Big Data and cloud architecture. 

SKILLS  

  • Deep understanding of advanced data warehousing concepts and track record of applying these concepts on the job.  
  • Ability to manage numerous projects concurrently and strategically, prioritizing when necessary.  
  • Good communication skills.  
  • Dynamic team player.  
  • A passion for technology.  

PLUSES  

Please note that these are desirable skills and are not required to apply for the position.  

  • Experience with Databricks.  
  • Experience with Data warehouses (such as data modeling and technical architectures) and infrastructure components. 
  • Deployment/scaling of apps on containerized environment (i.e., Kubernetes, AKS). 
  • Experience with Java or Scala.  
  • Experience with Jupyter Notebooks.  
  • Experience in Lambda data ingestion architecture.  
  • Experience with CI/CD.  
  • Familiar with Restful APIs. 
  • Experience with Artifact Repositories. 
  • Knowledge of the video game industry. 
  • Experience in Machine Learning pipelines and popular libraries.  

HOW TO APPLY 

Please apply with a resume and cover letter demonstrating how you meet the skills above. If we would like to move forward with your application, a Rockstar recruiter will reach out to you to explain next steps and guide you through the process. 

Rockstar is proud to be an equal opportunity employer, and we are committed to hiring, promoting, and compensating employees based on their qualifications and demonstrated ability to perform job responsibilities. 

If you’ve got the right skills for the job, we want to hear from you. We encourage applications from all suitable candidates regardless of age, disability, gender identity, sexual orientation, religion, belief, or race. 

The pay range for this position in New York State (inclusive of New York City) at the start of employment is expected to be between the range below* per year. However, base pay offered is based on market location, and may vary further depending on individualized factors for job candidates, such as job-related knowledge, skills, experience, and other objective business considerations. Subject to those same considerations, the total compensation package for this position may also include other elements, including a bonus and/or equity awards, in addition to a full range of medical, financial, and/or other benefits. Details of participation in these benefit plans will be provided if an employee receives an offer of employment. If hired, employee will be in an "at-will position" and the company reserves the right to modify base salary (as well as any other discretionary payment or compensation or benefit program) at any time, including for reasons related to individual performance, company or individual department/team performance, and market factors.

 

*NY Base Pay Range

$121,400 - $161,800 USD

Similar Jobs

oportun - Staff Software Engineer

oportun

Indianapolis, Indiana, United States (Remote)
1 Month ago
Egnyte - Staff Software Engineer

Egnyte

Mountain View, California, United States (Hybrid)
7 Months ago
Axonius - Senior Full Stack Engineer

Axonius

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
1 Month ago
Workato - Senior Infrastructure Engineer (OpenSearch)

Workato

Sofia, Sofia City Province, Bulgaria (On-Site)
1 Month ago
CyberArk - Staff Site Reliability Engineer

CyberArk

United States (Remote)
1 Month ago
BrightEdge - Database Engineer

BrightEdge

Hyderabad, Telangana, India (Remote)
8 Months ago
PwC - IN-Senior Associate_Azure data Engineer_Data &  Analytics_Advisory_PAN India

PwC

Bengaluru, Karnataka, India (On-Site)
9 Months ago
bytedance - Risk Data Analytics Business Partner - E-Commerce - Seattle

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago
playrix  - Senior Data Analyst (Attribution)

playrix

Georgia (Remote)
8 Months ago
N-ix - Data Engineer (with Databricks)

N-ix

Poland (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Enphase Energy - EVSE - Tech Lead Backend Developer

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Accenture - Technology Architect

Accenture

Hyderabad, Telangana, India (On-Site)
1 Month ago
bytedance - Site Reliability Engineer Graduate (Product RD and Infrastructure-Global E-Commerce) - 2024 Start (BS/MS)

bytedance

San Jose, California, United States (On-Site)
8 Months ago
shyft labs - Senior AI Engineer

shyft labs

Noida, Uttar Pradesh, India (On-Site)
2 Months ago
bounteous - Angular Developer

bounteous

Montreal, Quebec, Canada (Hybrid)
5 Months ago
Moving Walls India - Full Stack Developer

Moving Walls India

Chennai, Tamil Nadu, India (Remote)
3 Years ago
Vertx Inc. - Software Architect IV

Vertx Inc.

(Remote)
1 Month ago
Zynga - Senior Manager, Engineering

Zynga

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Performio - Senior Software Engineer

Performio

Bengaluru, Karnataka, India (Hybrid)
8 Months ago
Google - Software Engineer, Android, Photos

Google

Sydney, New South Wales, Australia (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New York, New York, United States

Monolith - Copy Editor, Streaming (Temporary)

Monolith

Atlanta, Georgia, United States (On-Site)
4 Months ago
Epic Games - Lead Counsel (Regulatory)

Epic Games

Cary, North Carolina, United States (On-Site)
4 Months ago
Rockstar Games - Senior Full Stack Engineer (C#/React)

Rockstar Games

New York, New York, United States (On-Site)
1 Year ago
Highspot - Associate Engineer Internship

Highspot

Seattle, Washington, United States (Hybrid)
2 Months ago
Epoch Games - Houdini Artist

Epoch Games

North Carolina, United States (Remote)
5 Months ago
WebTech Corporation - Mechanical Engineer IV

WebTech Corporation

Duncan, South Carolina, United States (On-Site)
1 Month ago
Blink Health - Product Manager

Blink Health

Pittsburgh, Pennsylvania, United States (On-Site)
1 Month ago
SBM Management - Custodial Lead

SBM Management

San Antonio, Texas, United States (On-Site)
4 Months ago
Tencent - Senior Game Analyst - North America, Latin America, and Australia & New Zealand Markets

Tencent

California, United States (On-Site)
4 Months ago
The Walt Disney Company - Security Host/Hostess

The Walt Disney Company

Kapolei, Hawaii, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

The Walt Disney Company - Sr Machine Learning Engineer

The Walt Disney Company

Los Angeles, California, United States (On-Site)
7 Months ago
PwC - IN_Senior Associate _GCP Developer _Data &Analytics _Advisory  _Ahmedabad

PwC

Ahmedabad, Gujarat, India (On-Site)
9 Months ago
Nagarro - Associate Principal Engineer, Big Data

Nagarro

Sri Lanka (Remote)
8 Months ago
GoMotive - Senior Strategic Analyst, Product Reliability

GoMotive

United States (Remote)
4 Months ago
HoYoverse - Legal Counsel (Privacy and Data Protection)

HoYoverse

Singapore (On-Site)
11 Months ago
Meta - Data Engineer, Product Analytics

Meta

San Francisco, California, United States (On-Site)
7 Months ago
PwC - Senior BI/Data analyst – Technology Consulting

PwC

Prague, Prague, Czechia (On-Site)
8 Months ago
bytedance - Data Analyst - Corporate Information System

bytedance

Singapore (On-Site)
3 Months ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Dundee, Scotland, United Kingdom (On-Site)

Edinburgh, Scotland, United Kingdom (On-Site)

Sydney, New South Wales, Australia (On-Site)

Sydney, New South Wales, Australia (On-Site)

New York, United States (On-Site)

Leeds, England, United Kingdom (On-Site)

Edinburgh, Scotland, United Kingdom (On-Site)

Edinburgh, Scotland, United Kingdom (On-Site)

Edinburgh, Scotland, United Kingdom (On-Site)

Edinburgh, Scotland, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Rockstar Games

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug