Lead Software Engineer

3 Months ago • 7 Years + • Data Analyst • $152,200 PA - $223,600 PA

Job Summary

Job Description

The Data Platforms Team seeks a Lead Software Engineer to contribute to the architecture, design, and growth of data products and pipelines using Scala and Python/Spark. Responsibilities include designing scalable data warehousing solutions, implementing Lakehouse architecture, leading modules, supporting data analysis for stakeholders, collaborating with cross-functional teams, maintaining documentation, ensuring operational efficiency, and advocating for agile practices. The ideal candidate possesses strong experience with cloud technologies (AWS), distributed systems (Spark), data integration tools (Airflow), data modeling, and SQL, along with excellent communication and problem-solving skills.
Must have:
  • 7+ years data engineering experience
  • AWS experience & data pipeline building
  • Strong SQL & Spark skills
  • Python programming expertise
  • Data modeling & analysis skills
Good to have:
  • MPP database experience (Snowflake, etc.)
  • Data warehousing methodologies
  • Software application development experience
  • AWS or cloud provider infrastructure as code
  • Scrum/Agile methodologies

Job Details

Job Summary:

Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

  • Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

About The Role

The Data Platforms Team, a segment under the Disney Entertainment & ESPN Technology (DEET) organization is looking for a Lead Software Engineer to join our Core Media Networks Data Team. Product Performance Data is critical to making product level decisions for the DEET Portfolio whether it’s related to product design, measuring advertising effectiveness, helping users discover new content or building new businesses in emerging markets. This data is deeply valuable and gives us insights into how we can continue improving our service for our users, advertisers and our content partners. Our Core Media Networks Data Engineering team is seeking a highly motivated Lead Data Engineer with a strong technical background who is passionate about designing and building systems to process data at scale to provide business value, create models and features that unlock powerful insights, and work across software and data disciplines to solve difficult unique problems at scale. Our tech stack includes AWS, Databricks, Airflow, Spark, Databricks and languages include Scala and Python.

Responsibilities

  • Contribute to the architecture, design and growth of our Data Products and Data pipelines in Scala and Python / Spark while maintaining uptime SLAs.

  • Design and develop scalable data warehousing solutions, building ETL pipelines in Big Data cloud environments.

  • Implement the Lakehouse architecture, working with key partners to shift towards a Lakehouse-centric data platform.

  • Lead a module and be well versed with the Business functionality to support Data questions and analysis for the Business stakeholders.

  • Able to understand Business Use Cases/ problems and provide relevant Business & technical solutions. 

  • Our tech stack includes AWS, Snowflake, Spark, Databricks, Delta Lake and Airflow and languages include Python, Scala.

  • Collaborate with Data Product Managers, Data Architects and Data Engineers to design, implement, and deliver successful data solutions.

  • Maintain detailed documentation of your work and changes to support data quality and data governance.

  • Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers (Data Science, Data Analytics teams)

  • Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team.

  • Be a problem solver; when presented with new challenges, you are expected to research and network to find solutions.

  • Seek out answers to business problems and look for opportunities to automate processes & optimize Cost.

  • Engage with and understand our customers, forming relationships that allow us to understand and prioritize both innovative new offerings and incremental platform improvements.

Basic Requirements

  • At least 7 years of data engineering experience developing large data pipelines.

  • Strong hands-on Experience with Cloud technologies like AWS (S3, EMR, EC2) and building data pipelines.

  • Strong algorithmic problem-solving expertise

  • Strong SQL skills and ability to create queries to extract data, build performant datasets and perform Data Analysis.

  • Strong Hands-on experience with distributed systems such as Spark, Pyspark to query and process data.

  • Strong fundamental Python programming skills.

  • Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines with Databricks.

  • Demonstrated competency in data modeling and analysis techniques.

  • Strong attention to detail and excellent analytical skills

  • Verbal and written communication skills and ability to collaborate with others effectively.

Preferred Qualifications

  • Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query)

  • Experience in Data Modeling techniques and Data Warehousing standard methodologies and practices

  • Experience with Software Application development.

  • Good data acumen to understand domain /functional knowledge and to be able to articulate analysis of data points in business context for stakeholders.

  • Demonstrated excellent interpersonal skills, communication skills including ability to partner with others and build consensus in a cross-functional team toward a desired outcome.

  • Experience working with a test first mentality.

  • Deep Understanding of AWS or other cloud providers as well as infrastructure as code

  • Familiar with Scrum and Agile methodologies

Required Education

  • Bachelor’s degree in computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience

Additional Information

#DISNEYTECH


The hiring range for this position in Santa Monica, California is $152,200 to $204,100 per year, in Bristol, Connecticut is $152,200 to $204,100 per year, in Seattle, Washington is $159,500 to $213,900 per year. in New York City, NY is $159,500 to $213,900 per year, and in San Francisco, California is $166,800 to $223,600 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Similar Jobs

Riot Games - Principal Analytics Engineer - Product Insights

Riot Games

Los Angeles, California, United States (On-Site)
1 Week ago
SparkCognition - Software Engineer (Scala_Backend)

SparkCognition

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Evolution - Backend Developer - Game Server

Evolution

Gothenburg, Västra Götaland County, Sweden (On-Site)
5 Months ago
The Walt Disney Company - Senior Data Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Week ago
The Walt Disney Company - Lead Software Engineer (Identity)

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
4 Months ago
Virtuos - R&D Data Engineering Lead

Virtuos

Shanghai, Shanghai, China (On-Site)
1 Week ago
PwC - IN_Senior Associate _Java Developer _Data & Analytics _Advisory _PAN India

PwC

Kolkata, West Bengal, India (On-Site)
5 Months ago
Playtika - Youda - Data Analyst

Playtika

Netherlands (Hybrid)
5 Months ago
Hawk Eye Innovations - Sports Data Quality Specialist

Hawk Eye Innovations

Sofia, Sofia City Province, Bulgaria (On-Site)
6 Days ago
Tencent - Game Operation Manager

Tencent

Shenzhen, Guangdong Province, China (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - IN-Senior Associate_PySpark Developer_Data & Analytics_Advisory_ PAN India

PwC

Gurugram, Haryana, India (On-Site)
5 Months ago
Velotio Technologies - Software Engineer (Data Engineering)

Velotio Technologies

Maharashtra, India (Remote)
5 Days ago
Zazz - Machine Learning Engineer

Zazz

(Remote)
1 Month ago
Anavation - Full Stack Developer

Anavation

Washington, District Of Columbia, United States (Hybrid)
1 Month ago
Playrix - Technical Director (Game Project)

Playrix

Cyprus (Remote)
5 Months ago
Riot Games - Principal Analytics Engineer - Product Insights

Riot Games

Los Angeles, California, United States (On-Site)
1 Week ago
Playrix - Senior Engineering Manager

Playrix

Georgia (Remote)
5 Months ago
InMobiInMobi - Solutions Engineer

InMobiInMobi

London, England, United Kingdom (On-Site)
6 Days ago
Reality Games - Data Analyst - Monopoly World

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Week ago
Appier - Senior Software Engineer, Backend Development

Appier

Taipei City, Taiwan (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Washington, United States

Canva - Corporate Accounting Lead

Canva

Los Angeles, California, United States (Remote)
1 Month ago
Everyday Health Group - Principal Software Engineer - Android

Everyday Health Group

Massachusetts, United States (Remote)
2 Months ago
PlayStation Global - Senior Visual Effects Artist

PlayStation Global

United States (Remote)
6 Days ago
The Walt Disney Company - Sr. FinOps Tech Data Analyst

The Walt Disney Company

Washington, United States (On-Site)
1 Week ago
ByteDance - Software Development Engineer - Cloud Native Databases

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
Next Level Business Services - Webfocus Developer

Next Level Business Services

Plantation, Florida, United States (On-Site)
5 Months ago
Moonbug Entertainment - Production Coordinator, Brands

Moonbug Entertainment

Los Angeles, California, United States (On-Site)
6 Days ago
Riot Games - Staff Software Engineer (Services) - Teamfight Tactics, Core Tech

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Saviynt - Java Senior Engineer, Software Engineering

Saviynt

El Segundo, California, United States (Hybrid)
5 Months ago
Sinch - Product Marketing Manager, Sinch SMS & MMS

Sinch

United States (Remote)
5 Days ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Playrix - Senior Data Analyst (Game)

Playrix

Portugal (Remote)
5 Months ago
RoofStack - Data Product Manager

RoofStack

İstanbul, İstanbul, Türkiye (On-Site)
4 Days ago
Xsolla - Anti-Fraud Analyst

Xsolla

France (Hybrid)
5 Days ago
CloudHire - Power BI Expert

CloudHire

Maharashtra, India (Remote)
6 Days ago
Riot Games - Insights Analyst III - VALORANT, Cross VALORANT Experience

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Head Digital Works - Business Intelligence Analyst

Head Digital Works

Hyderabad, Telangana, India (On-Site)
5 Months ago
Mistplay - Senior Data Analyst I, Growth Analytics

Mistplay

Toronto, Ontario, Canada (Hybrid)
1 Week ago
ByteDance - Senior Data Scientist

ByteDance

Seattle, Washington, United States (On-Site)
6 Days ago
Zazz - Marketing Data Specialist

Zazz

India (On-Site)
3 Months ago
Glean - Data Science, Product

Glean

Palo Alto, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

From classic animated features and exhilarating theme park attractions to cutting edge sports coverage, and the hottest shows on television, The Walt Disney Company has been making magic since 1923, creating unforgettable stories that connect with audiences around the world. And we’re just getting started!

The key to our success…. The Cast, Crew, Imagineers and Employees who honor Disney’s rich legacy by stretching the bounds of imagination to create the never-before-seen, bringing unparalleled entertainment experiences to people of all ages. Begin a career that delivers unparalleled creative content and experiences to audiences around the world and just imagine the stories you could be part of…

What is #LifeAtDisney like? It’s a series of magical moments with cast members and employees developing and telling our stories in the most innovative ways. Whether it’s a day spent as a Disney VoluntEAR, or celebrating the release of a new interactive experience, retail product or movie, our days are filled with the knowledge that we are creating entertainment experiences the whole family can enjoy. Follow @DisneyCareers on Facebook, Twitter and Instagram for a peek behind-the-curtain, and discover how you could connect to a world of stories with Disney!

Anaheim, California, United States (On-Site)

Lake Buena Vista, Florida, United States (On-Site)

Hong Kong (On-Site)

Papenburg, Lower Saxony, Germany (On-Site)

Hong Kong (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

View All Jobs

Get notified when new jobs are added by The Walt Disney Company

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug