Senior Data Engineer

3 Months ago • 3-5 Years • $136,100 PA - $199,800 PA

Job Summary

Job Description

The Search Machine Learning (ML) team at Disney powers the ML aspects of search engines for Disney+ and Hulu platforms. You will be responsible for designing and developing offline/near-line data jobs, collaborating with ML and data practitioners to automate their pipelines, building tooling and low-latency services to support event-driven systems. You will also work in an Agile environment, collaborating with engineers from diverse backgrounds and across teams.
Must have:
  • 5+ years of software experience
  • 3+ years of data and software experience
  • Knowledge of Python/Java data ecosystem
  • Experience building large datasets and scalable services
  • Experience deploying and running services in AWS
  • Experience engineering big-data solutions using Databricks, EMR, S3, Spark
  • Experience loading and querying cloud-hosted databases like Redshift and Snowflake
  • Experience designing and developing backend microservices using gRPC or REST
  • Experience with large-scale distributed data processing systems
Good to have:
  • Knowledge in optimizing Spark jobs
  • Experience building streaming pipelines using Kafka, Spark, Kinesis

Job Details

Job Summary:

Department/Group Overview:

Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

  • Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

Commerce, Growth & Identity (CGI)

The Commerce, Growth & Identity (CGI) team is dedicated to three business-critical areas at Disney that will help transform its media business. They create seamless user experiences for consumers who can choose from a wide range of subscription plans, enabling more choice and flexibility. The CGI team is also focused on building innovative and cutting-edge capabilities that will drive subscriptions, engagement, and monetization across Disney’s streaming and digital products.

Job Summary:

The Search Machine Learning (ML) team powers the ML aspects of search engines for Disney+ and Hulu platforms, in a highly collaborative environment. ML-based services are embedded inside the entire life cycle of search journey, from query understanding, semantic retrieval, and engagement-based re-ranking of contents. Working closely with our core search counterpart team and product stakeholders, we are constantly testing new ideas, and bringing the proven ones into fruition, through experimentation.

In this role, you will be partnering closely with ML engineers/data scientists to help automate and manage their data needs for regular training, and online inference. You will be able to own the entire lifecycle of data pipelines, communicate your requirements with upstream DATA teams, bring your data engineering skills and ideas into life by engineering efficient data pipelines, and help supporting the feature requirements by the ML engineers/data scientists.

Responsibilities and Duties of the Role:

  • Design and develop offline (batch)/near-line (streaming) data jobs.

  • Collaborate with ML and data practitioners to automate their pipelines.

  • Build tooling and low-latency services to enable and support event-driven

  • Ability to work on multi-faceted projects with engineers from diverse backgrounds, heterogenous skills and across teams.

  • Work in an Agile environment that focuses on collaboration and teamwork

Required Education, Experience/Skills/Training:

Basic Qualifications

  • 5+ years of software experience, with 3+ years of relevant data and software experience.

  • Knowledge of the Python/Java data ecosystem.

  • Experience in building large datasets and scalable services

  • Experience deploying and running services in AWS, and engineering big-data solutions using technologies like Databricks, EMR, S3, Spark

  • Experience loading and querying cloud-hosted databases such as Redshift and Snowflake

  • Experience designing and developing backend microservices for large scale distributed systems using gRPC or REST.

  • Experience with large-scale distributed data processing systems, cloud infrastructure such as AWS or GCP.

Preferred Qualifications

  • Knowledge in optimizing Spark jobs.

  • Experience building streaming pipelines using Kafka, Spark, Kinesis

  • Mentor colleagues on best practices and technical concepts of building large scale solutions

Required Education

  • Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work


The hiring range for this position in Los Angeles, CA, Santa Monica, CA, and Bristol, CT is $136,100.00 - $182,400.00 per year, in Seattle, WA and New York, NY is $142,600.00 - $191,100.00 per year and in San Francisco, CA $149,000.00 - $199,800.00 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Similar Jobs

Devoteam - Distributed Cloud l Google Data Project

Devoteam

(Remote)
4 Months ago
ION - Senior Software Engineer, Italy

ION

Rome, Lazio, Italy (On-Site)
4 Months ago
PwC - IN-Senior Associate-_AEM Developer_Advisory Corporate_Advisory_  Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
4 Months ago
The AES Group - Lead Audio Engineer - Automotive

The AES Group

Pune, Maharashtra, India (On-Site)
5 Months ago
HP - User Administration & Support Analyst

HP

Tlaquepaque, Jalisco, Mexico (On-Site)
4 Months ago
The Walt Disney Company - Sr Software Engineer (Roku)

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
3 Months ago
Evermore Orlando Resort - Sand Sculptor Artist

Evermore Orlando Resort

Orlando, Florida, United States (On-Site)
7 Months ago
workato - Staff Infrastructure Engineer

workato

Athens, Greece (On-Site)
4 Months ago
Ubisoft - Senior Release & Build Specialist

Ubisoft

Chengdu, Sichuan, China (On-Site)
7 Months ago
Ubisoft - Programming Architect - Projet non annoncé - F/H/NB

Ubisoft

Montreuil, Île-de-France, France (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

DISCO - Software Engineer III, UI (India)

DISCO

Gurugram, Haryana, India (On-Site)
5 Months ago
PwC - Senior Data Scientist

PwC

Warsaw, Masovian Voivodeship, Poland (Hybrid)
4 Months ago
PENN Interactive - Senior Data Engineer, Java

PENN Interactive

Philadelphia, Pennsylvania, United States (Hybrid)
4 Months ago
Google - Mainframe Modernization Consultant, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
3 Months ago
PwC - Senior Associate | Automation QA

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Pluralsight - Senior Salesforce Developer

Pluralsight

United States (Remote)
4 Months ago
Playrix - Senior QA Engineer (VSO Engine)

Playrix

Ireland (Remote)
4 Months ago
ByteDance - Software Engineer (ElasticSearch / OpenSearch) - Cloud Infrastructure- San Jose

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Google - Software Engineer II, Infrastructure, Core

Google

Hyderabad, Telangana, India (On-Site)
3 Months ago
Nasdaq - Software Developer Specialist - Java Backend

Nasdaq

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Monica, California, United States

ByteDance - Product Manager, LLM Data Acquisition and Production

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
ByteDance - Technical PMO, Global E-commerce Engineering

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Insomniacs - Character Art Intern - Undergraduate

Insomniacs

Burbank, California, United States (On-Site)
4 Months ago
The H Toji Companies - ADA Sign Company artist skilled in Illustrator (Mac only)

The H Toji Companies

Lakewood, California, United States (Hybrid)
5 Months ago
Nisum - UI Developer - AB6683

Nisum

Plano, Texas, United States (On-Site)
4 Months ago
Google - Customer Learning Lead, Cloud Learning Services

Google

Boulder, Colorado, United States (On-Site)
3 Months ago
WebMD - Business Analyst (Data Analyst)

WebMD

Newark, New Jersey, United States (On-Site)
4 Months ago
Zuru - Spatial Experience Designer

Zuru

Los Angeles, California, United States (On-Site)
4 Months ago
ByteDance - Enterprise Sales Channel Manager - PICO

ByteDance

New York, New York, United States (On-Site)
3 Months ago
Interactive Brokers - Senior Data Engineer

Interactive Brokers

Greenwich, Connecticut, United States (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

workato - Senior Software Engineer (Platform)

workato

Belgrade, Serbia (On-Site)
4 Months ago
Bloxd - Game Engine Developer

Bloxd

London, England, United Kingdom (On-Site)
7 Months ago
workato - Sales Development Representative

workato

Dublin, County Dublin, Ireland (On-Site)
4 Months ago
HP - Inside Presales Technical Consultant, India Market (Hindi Speaking, No Prior Experience Welcome)

HP

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
5 Months ago
Tata Consultancy Services (TCS) - AR / VR / Metaverse Developer

Tata Consultancy Services (TCS)

Chennai, Tamil Nadu, India (On-Site)
5 Months ago
Windranger Labs - Senior Smart Contract Engineer / Expert 智能合约专家

Windranger Labs

(On-Site)
6 Months ago
Bally's Interactive - Promotions Executive

Bally's Interactive

(On-Site)
3 Months ago
Ziff Davis - Senior Software Engineer

Ziff Davis

Austin, Texas, United States (Remote)
4 Months ago
Bally's Interactive - iOS Developer

Bally's Interactive

(Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

From classic animated features and exhilarating theme park attractions to cutting edge sports coverage, and the hottest shows on television, The Walt Disney Company has been making magic since 1923, creating unforgettable stories that connect with audiences around the world. And we’re just getting started!

The key to our success…. The Cast, Crew, Imagineers and Employees who honor Disney’s rich legacy by stretching the bounds of imagination to create the never-before-seen, bringing unparalleled entertainment experiences to people of all ages. Begin a career that delivers unparalleled creative content and experiences to audiences around the world and just imagine the stories you could be part of…

What is #LifeAtDisney like? It’s a series of magical moments with cast members and employees developing and telling our stories in the most innovative ways. Whether it’s a day spent as a Disney VoluntEAR, or celebrating the release of a new interactive experience, retail product or movie, our days are filled with the knowledge that we are creating entertainment experiences the whole family can enjoy. Follow @DisneyCareers on Facebook, Twitter and Instagram for a peek behind-the-curtain, and discover how you could connect to a world of stories with Disney!

Burbank, California, United States (On-Site)

Burbank, California, United States (On-Site)

Los Angeles, California, United States (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

Hong Kong (On-Site)

Amsterdam, North Holland, Netherlands (On-Site)

Minato City, Tokyo, Japan (On-Site)

Minato City, Tokyo, Japan (On-Site)

View All Jobs

Get notified when new jobs are added by The Walt Disney Company

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug