Senior Data Engineer

2 Months ago • 5 Years + • DevOps • $138,900 PA - $203,900 PA

Job Summary

Job Description

As a Sr. Data Engineer, you'll develop and improve feature store tooling and services, contributing to the ML infrastructure. You'll collaborate with ML practitioners to build a streaming data ecosystem and develop low-latency services for event-driven pipelines. This role involves working on multifaceted projects with diverse teams, driving a culture of quality and innovation within an Agile environment. Responsibilities include building big data pipelines, utilizing cloud technologies (AWS or GCP), and working with container systems (Docker or Kubernetes). You'll own and expand the central feature store powering ML use cases in recommendations, search, and fraud detection.
Must have:
  • 5+ years software experience in large-scale, real-time systems
  • Big data pipeline building and deployment
  • AWS/GCP cloud and Docker/Kubernetes experience
  • Excellent communication and collaboration skills
Good to have:
  • ML pipeline and AWS familiarity
  • Experience building ML infrastructure and streaming applications
  • Entertainment/media streaming application experience

Job Details

Job Summary:

Disney Entertainment & ESPN Technology 

On any given day at Disney Entertainment & ESPN Technology, we are reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that is evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world. 

 

A few reasons why we think you would love working for Disney Entertainment & ESPN Technology 

  • Building the future of Disney’s media business: DE&E (Disney Entertainment & ESPN) Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come. 

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more. 

  • Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news. 

 

The vision of the Machine Learning (ML) Engineering team at Disney is to drive and enable ML usage across several domains in heterogeneous language environments and at all stages of a project’s life cycle, including ad-hoc exploration, preparing training data, model development, and robust production deployment.  The team is invested in continual innovation on the ML infrastructure itself to carefully orchestrate a continuous cycle of learning, inference, and observation while also maintaining high system availability and reliability. We seek to maximize the positive business impact of all ML at Disney streaming by supporting key product functions like personalization and recommendation, fraud and abuse prevention, capacity planning, subscriber growth and lifecycle intelligence, and so on. 

 

In this role you will work on event and context processors to federate data, infrastructure and tooling to enable event-driven ML pipelines. You will own and expand part of our central feature store that powers ML use cases in domains like recommendations, search and fraud. You will work on cross-functional projects and push the envelope on data and ML infrastructure. 

 

What You Will Do: 

  • Develop and improve feature store tooling and services, and contribute to the ML infrastructure development 

  • Collaborate with ML practitioners to build streaming data ecosystem 

  • Develop low-latency services to enable and support event-driven pipelines 

  • Ability to work on multi-faceted projects with engineers from diverse backgrounds, heterogenous skills and across teams 

  • Drive and maintain a culture of quality, innovation and experimentation 

  • Work in an Agile environment that focuses on collaboration and teamwork 

 

What You Will Bring: 

Basic Qualifications  

  • 5+ years of software experience working in large scale, real-time distributed systems 

  • Experience building and deploying big data pipelines in production 

  • Experience with cloud technologies in AWS (Amazon Web Services) or GCP as well as container systems such as Docker or Kubernetes 

  • Excellent communication and people engagement skills 

Preferred Qualifications  

  • Passion for building platforms and infrastructure excellence 

  • Familiarity with ML pipelines, data ecosystem and AWS technologies 

  • Building ML infrastructure, streaming ML applications 

  • Experience shipping entertainment and media applications for streaming purposes 

 

Required Education   

  • Bachelor’s degree in computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience 

 


The hiring range for this position in Santa Monica, California is $138,900.00-$186,200.00 per year and in San Francisco, California is $152,100.00 - $203,900.00 per year. The hiring range for this position in in New York, New York and Seattle, Washington is $145,400.00 - $195,000.00 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Similar Jobs

Tencent - Tencent Cloud - Senior Cloud Architect (R&D & Solution Design)

Tencent

Singapore (On-Site)
4 Months ago
seeking alpha - Senior Back-End Developer

seeking alpha

Israel (Remote)
3 Months ago
Mistplay - Senior DevOps Engineer II

Mistplay

Montreal, Quebec, Canada (Hybrid)
2 Months ago
Limit Break - Senior Site Reliability Engineer

Limit Break

Tokyo, Japan (On-Site)
6 Days ago
Activision - Expert Engineer, Accounts and Authentication

Activision

Dublin, County Dublin, Ireland (On-Site)
3 Weeks ago
CloudLinux - Senior Site Reliability Engineer

CloudLinux

(Remote)
5 Days ago
Saviynt - Senior Principal Software Engineer - Privileged Access Management (PAM)

Saviynt

El Segundo, California, United States (Hybrid)
5 Months ago
Velotio Technologies - Senior DevOps Engineer (GCP)

Velotio Technologies

Maharashtra, India (Remote)
1 Week ago
Trend Micro - (Sr.) Cloud Developer (Vision One)

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago
ByteDance - Senior Software Engineer - Serverless Compute Infrastructure

ByteDance

San Jose, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Turbulent - Full Stack Developer

Turbulent

Montreal, Quebec, Canada (On-Site)
2 Weeks ago
Electronic Arts - DevOps Engineer II

Electronic Arts

Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, Malaysia (On-Site)
20 Hours ago
seeking alpha - Senior Back-End Developer

seeking alpha

Israel (Remote)
3 Months ago
1047 Games - Senior Game Platform Engineer

1047 Games

(Remote)
1 Month ago
Applike Group - Tech Lead - Backend Services (Go) (f/m/d)

Applike Group

Hamburg, Hamburg, Germany (Hybrid)
5 Months ago
Crunchyroll - Principal Technical Product Manager - Application Security

Crunchyroll

San Francisco, California, United States (On-Site)
3 Weeks ago
Inworld AI - Staff Cloud DevOps/Site Reliability Engineer (SRE) - USA

Inworld AI

Mountain View, California, United States (On-Site)
8 Months ago
Nielsen Holdings - DevOps Engineer (Terraform, Jenkins, GitLab CI/CD, Python, Airflow)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Social Discovery Group - Deputy Head of Customer IT Infrastructure

Social Discovery Group

Georgia (Remote)
5 Months ago
Riot Games - Software Engineering Manager - Content Access Platform

Riot Games

Dublin, County Dublin, Ireland (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

The Walt Disney Company - Lead Software Engineer (Roku Engineer)

The Walt Disney Company

Charlotte, North Carolina, United States (On-Site)
4 Months ago
ION - Compliance Officer - Options/Equity Trading - 9821

ION

Jersey City, New Jersey, United States (On-Site)
5 Months ago
Light Speed Studios - Senior Technical Artist

Light Speed Studios

Los Angeles, California, United States (On-Site)
5 Months ago
Epic Games - Senior Pipeline Developer

Epic Games

Cary, North Carolina, United States (On-Site)
2 Months ago
Next Level Business Services - Full Stack Developer

Next Level Business Services

Boston, Massachusetts, United States (On-Site)
5 Months ago
Crunchyroll - Principal Product Manager, Discovery & Engagement

Crunchyroll

San Francisco, California, United States (On-Site)
1 Month ago
Valve corporation - Steam Support Leadership

Valve corporation

Bellevue, Washington, United States (On-Site)
2 Months ago
Rockstar Games - Animation Systems Programmer

Rockstar Games

New York, New York, United States (On-Site)
1 Month ago
ByteDance - Research Scientist, Foundation Model, Music Intelligence

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Light Speed Studios - Art Director

Light Speed Studios

Los Angeles, California, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Meta - Production Engineer

Meta

Dublin, County Dublin, Ireland (On-Site)
4 Months ago
SmileGate - Platform Engineering Manager

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
2 Months ago
Rackspace Technology - Python Software Engineer IV

Rackspace Technology

India (Remote)
6 Days ago
Scopely - Principal Server Engineer, Infrastructure

Scopely

Barcelona, Catalonia, Spain (On-Site)
2 Months ago
GoTo Group - Site Reliability Engineer - EP (SE4)

GoTo Group

Bengaluru, Karnataka, India (On-Site)
5 Months ago
ByteDance - Senior Site Reliability Engineer, AI Applications

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
Oriserve - Senior DevOps Engineer (4+ Yrs exp)

Oriserve

Noida, Uttar Pradesh, India (On-Site)
5 Months ago
Ajmera Infotech - Site Reliability Engineer (SRE) - Kubernetes

Ajmera Infotech

Austin, Texas, United States (On-Site)
2 Months ago
Ubisoft - Intermediate/Senior Tools Programmer

Ubisoft

Malmö, Skåne County, Sweden (Hybrid)
3 Weeks ago
Nielsen Holdings - Software Engineer - Bigdata (Java/ Scala/ Python ,SQL , AWS)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

From classic animated features and exhilarating theme park attractions to cutting edge sports coverage, and the hottest shows on television, The Walt Disney Company has been making magic since 1923, creating unforgettable stories that connect with audiences around the world. And we’re just getting started!

The key to our success…. The Cast, Crew, Imagineers and Employees who honor Disney’s rich legacy by stretching the bounds of imagination to create the never-before-seen, bringing unparalleled entertainment experiences to people of all ages. Begin a career that delivers unparalleled creative content and experiences to audiences around the world and just imagine the stories you could be part of…

What is #LifeAtDisney like? It’s a series of magical moments with cast members and employees developing and telling our stories in the most innovative ways. Whether it’s a day spent as a Disney VoluntEAR, or celebrating the release of a new interactive experience, retail product or movie, our days are filled with the knowledge that we are creating entertainment experiences the whole family can enjoy. Follow @DisneyCareers on Facebook, Twitter and Instagram for a peek behind-the-curtain, and discover how you could connect to a world of stories with Disney!

Anaheim, California, United States (On-Site)

Lake Buena Vista, Florida, United States (On-Site)

Hong Kong (On-Site)

Papenburg, Lower Saxony, Germany (On-Site)

Hong Kong (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

View All Jobs

Get notified when new jobs are added by The Walt Disney Company

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug