Lead Data Engineer

3 Months ago • 7 Years + • DevOps • $152,200 PA - $223,600 PA

Job Summary

Job Description

The Lead Data Engineer will develop and improve feature store tooling and services, contributing to ML infrastructure development. Responsibilities include collaborating with ML practitioners to build streaming data ecosystems, developing low-latency services for event-driven pipelines, working on multifaceted projects across diverse teams, and driving a culture of quality and innovation. The role involves working on event and context processors to federate data and building a central feature store for ML use cases in recommendations, search, and fraud detection. The ideal candidate will have 7+ years of experience in large-scale, real-time distributed systems and experience with cloud technologies (AWS or GCP) and container systems (Docker or Kubernetes).
Must have:
  • 7+ years software experience in large-scale systems
  • Big data pipeline building and deployment
  • AWS or GCP cloud technologies experience
  • Docker/Kubernetes experience
  • Develop feature store tooling and services
  • Build streaming data ecosystems
Good to have:
  • Familiarity with ML pipelines and AWS
  • Building ML infrastructure, streaming ML applications
  • Experience with entertainment and media streaming applications

Job Details

Job Summary:

Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we are reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that is evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you would love working for Disney Entertainment & ESPN Technology

  • Building the future of Disney’s media business: DE&E (Disney Entertainment & ESPN) Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

The vision of the Machine Learning (ML) Engineering team at Disney is to drive and enable ML usage across several domains in heterogeneous language environments and at all stages of a project’s life cycle, including ad-hoc exploration, preparing training data, model development, and robust production deployment.  The team is invested in continual innovation on the ML infrastructure itself to carefully orchestrate a continuous cycle of learning, inference, and observation while also maintaining high system availability and reliability. We seek to maximize the positive business impact of all ML at Disney streaming by supporting key product functions like personalization and recommendation, fraud and abuse prevention, capacity planning, subscriber growth and lifecycle intelligence, and so on. In this role you will work on event and context processors to federate data, infrastructure and tooling to enable event-driven ML pipelines. You will own and expand part of our central feature store that powers ML use cases in domains like recommendations, search and fraud. You will work on cross-functional projects and push the envelope on data and ML infrastructure.

Responsibilities:

  • Develop and improve feature store tooling and services, and contribute to the ML infrastructure development

  • Collaborate with ML practitioners to build streaming data ecosystem

  • Develop low-latency services to enable and support event-driven pipelines

  • Ability to work on multi-faceted projects with engineers from diverse backgrounds, heterogenous skills and across teams

  • Drive and maintain a culture of quality, innovation and experimentation

  • Work in an Agile environment that focuses on collaboration and teamwork

Basic Qualifications:

  • Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience

  • 7+ years of software experience working in large scale, real-time distributed systems

  • Experience building and deploying big data pipelines in production

  • Experience with cloud technologies in AWS (Amazon Web Services) or GCP as well as container systems such as Docker or Kubernetes

  • Passion for building platforms and infrastructure excellence

  • Excellent communication and people engagement skills

Preferred Qualifications:

  • Familiarity with ML pipelines, data ecosystem and AWS technologies

  • Building ML infrastructure, streaming ML applications

  • Experience shipping entertainment and media applications for streaming purposes

#DISNEYTECH


The hiring range for this position in New York is $159,500-$213,900 per year and in San Francisco is $166,800-$223,600 per year and Los Angeles is $152,200-$204,100 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Similar Jobs

Immutable - Senior Site Reliability Engineer

Immutable

Sydney, New South Wales, Australia (Hybrid)
4 Months ago
CharacterAI - Software Engineer, Backend

CharacterAI

Menlo Park, California, United States (On-Site)
6 Days ago
Maersk Careers - Senior Elixir Software Engineer - Energy Transition

Maersk Careers

Porto, Porto District, Portugal (Remote)
3 Months ago
Patreon - Site Reliability Engineer

Patreon

United States (Remote)
6 Days ago
Rackspace Technology - AWS Support Engineer L2

Rackspace Technology

Gurugram, Haryana, India (Remote)
3 Weeks ago
Info Stretch - .Net Architect

Info Stretch

Mechanicsburg, Pennsylvania, United States (On-Site)
4 Months ago
Auros Global - Senior Site Reliability Engineer

Auros Global

United Kingdom (Remote)
2 Weeks ago
Aera Technology - Senior Platform Administration Engineer

Aera Technology

Bucharest, Bucharest, Romania (Hybrid)
5 Months ago
Ubisoft - Back-End Golang Developer

Ubisoft

Montreal, Quebec, Canada (On-Site)
4 Weeks ago
Company3 Method Studios - Technical Architect D365 Finance &Operations

Company3 Method Studios

Pune, Maharashtra, India (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Skillz - Lead Web Full Stack Engineer (Las Vegas)

Skillz

Las Vegas, Nevada, United States (On-Site)
2 Months ago
Onward Search - Senior Cloud Architect

Onward Search

Santa Monica, California, United States (Hybrid)
2 Months ago
ION - Cloud Engineer Kubernetes

ION

Castellazzo Bormida, Piedmont, Italy (Hybrid)
5 Months ago
NVIDIA - Senior System Software Engineer - AI Performance and Efficiency Tools

NVIDIA

Santa Clara, California, United States (Hybrid)
2 Weeks ago
Genies - Backend Engineer Intern (LLM)

Genies

San Mateo, California, United States (Hybrid)
6 Days ago
NVIDIA - Senior Research Engineer for Reinforcement Learning

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
Adtran - Software Engineer

Adtran

Hyderabad, Telangana, India (On-Site)
6 Months ago
Zazz - Cloud Engineer (Azure)

Zazz

(Remote)
1 Month ago
Axinous - Sr. Staff ML Engineer

Axinous

San Jose, California, United States (Hybrid)
2 Months ago
seeking alpha - Expert Ruby on Rails Developer

seeking alpha

Poland (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

The Walt Disney Company - KFSN Promotion Producer

The Walt Disney Company

Fresno, California, United States (On-Site)
6 Days ago
AI Fund - Head of AI @ Olakai

AI Fund

California, United States (Remote)
5 Months ago
Trackman - Trackman Baseball System Operator

Trackman

Arizona, United States (On-Site)
6 Days ago
Entrata - Regional Vice President of Sales | IC Role | Northeast Region

Entrata

United States (Remote)
5 Months ago
Onward Search - Software Engineer

Onward Search

Rochester, Minnesota, United States (Remote)
1 Month ago
Next Level Business Services - Salesforce Solution Architect

Next Level Business Services

Diamond Bar, California, United States (On-Site)
5 Months ago
Riot Games - Staff Anti-Cheat Analyst

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago
Nintendo - Sr Product Experience Analyst (Bilingual Japanese)

Nintendo

Redmond, Washington, United States (Hybrid)
4 Months ago
Nintendo - Senior Income Tax Accountant

Nintendo

Redmond, Washington, United States (Hybrid)
7 Months ago
Meta - Production Engineering

Meta

Boston, Massachusetts, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Wildlife Studios - Senior Site Reliability Engineer

Wildlife Studios

São Paulo, State Of São Paulo, Brazil (On-Site)
1 Week ago
Cargo Studio - MIS Engineer

Cargo Studio

(On-Site)
1 Month ago
Rackspace Technology - Lead Azure Data Engineer (Tech Lead)

Rackspace Technology

New York, New York, United States (On-Site)
3 Months ago
Zeta - Site Reliability Engineer I (Payzapp)

Zeta

Bengaluru, Karnataka, India (On-Site)
5 Months ago
PeopleFun - Senior Game Server Engineer II, Wordscapes

PeopleFun

United States (Remote)
1 Week ago
Trend Micro - Cloud Engineer (Golang/Python, Backend Focus) 雲端開發工程師

Trend Micro

Taipei City, Taiwan (On-Site)
5 Months ago
ByteDance - Solutions Architect

ByteDance

(On-Site)
6 Days ago
NVIDIA - Senior Site Reliability Engineer - GPU Clusters

NVIDIA

Austin, Texas, United States (On-Site)
1 Month ago
GoTo Group - Site Reliability Engineer - EP (SE4)

GoTo Group

Gurugram, Haryana, India (On-Site)
5 Months ago
Gearbox Software - Senior Site Reliability Engineer

Gearbox Software

Frisco, Texas, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

From classic animated features and exhilarating theme park attractions to cutting edge sports coverage, and the hottest shows on television, The Walt Disney Company has been making magic since 1923, creating unforgettable stories that connect with audiences around the world. And we’re just getting started!

The key to our success…. The Cast, Crew, Imagineers and Employees who honor Disney’s rich legacy by stretching the bounds of imagination to create the never-before-seen, bringing unparalleled entertainment experiences to people of all ages. Begin a career that delivers unparalleled creative content and experiences to audiences around the world and just imagine the stories you could be part of…

What is #LifeAtDisney like? It’s a series of magical moments with cast members and employees developing and telling our stories in the most innovative ways. Whether it’s a day spent as a Disney VoluntEAR, or celebrating the release of a new interactive experience, retail product or movie, our days are filled with the knowledge that we are creating entertainment experiences the whole family can enjoy. Follow @DisneyCareers on Facebook, Twitter and Instagram for a peek behind-the-curtain, and discover how you could connect to a world of stories with Disney!

Anaheim, California, United States (On-Site)

Lake Buena Vista, Florida, United States (On-Site)

Hong Kong (On-Site)

Papenburg, Lower Saxony, Germany (On-Site)

Hong Kong (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

View All Jobs

Get notified when new jobs are added by The Walt Disney Company

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug