Lead Software Engineer

1 Month ago • 7 Years + • Data Analyst • $152,200 PA - $223,600 PA

Job Summary

Job Description

The Data Platforms Team seeks a Lead Software Engineer to contribute to the architecture, design, and growth of data products and pipelines using Scala and Python/Spark. Responsibilities include designing scalable data warehousing solutions, implementing Lakehouse architecture, leading modules, supporting data analysis for stakeholders, collaborating with cross-functional teams, maintaining documentation, ensuring operational efficiency, and advocating for agile practices. The ideal candidate possesses strong experience with cloud technologies (AWS), distributed systems (Spark), data integration tools (Airflow), data modeling, and SQL, along with excellent communication and problem-solving skills.
Must have:
  • 7+ years data engineering experience
  • AWS experience & data pipeline building
  • Strong SQL & Spark skills
  • Python programming expertise
  • Data modeling & analysis skills
Good to have:
  • MPP database experience (Snowflake, etc.)
  • Data warehousing methodologies
  • Software application development experience
  • AWS or cloud provider infrastructure as code
  • Scrum/Agile methodologies

Job Details

Job Summary:

Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

  • Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

About The Role

The Data Platforms Team, a segment under the Disney Entertainment & ESPN Technology (DEET) organization is looking for a Lead Software Engineer to join our Core Media Networks Data Team. Product Performance Data is critical to making product level decisions for the DEET Portfolio whether it’s related to product design, measuring advertising effectiveness, helping users discover new content or building new businesses in emerging markets. This data is deeply valuable and gives us insights into how we can continue improving our service for our users, advertisers and our content partners. Our Core Media Networks Data Engineering team is seeking a highly motivated Lead Data Engineer with a strong technical background who is passionate about designing and building systems to process data at scale to provide business value, create models and features that unlock powerful insights, and work across software and data disciplines to solve difficult unique problems at scale. Our tech stack includes AWS, Databricks, Airflow, Spark, Databricks and languages include Scala and Python.

Responsibilities

  • Contribute to the architecture, design and growth of our Data Products and Data pipelines in Scala and Python / Spark while maintaining uptime SLAs.

  • Design and develop scalable data warehousing solutions, building ETL pipelines in Big Data cloud environments.

  • Implement the Lakehouse architecture, working with key partners to shift towards a Lakehouse-centric data platform.

  • Lead a module and be well versed with the Business functionality to support Data questions and analysis for the Business stakeholders.

  • Able to understand Business Use Cases/ problems and provide relevant Business & technical solutions. 

  • Our tech stack includes AWS, Snowflake, Spark, Databricks, Delta Lake and Airflow and languages include Python, Scala.

  • Collaborate with Data Product Managers, Data Architects and Data Engineers to design, implement, and deliver successful data solutions.

  • Maintain detailed documentation of your work and changes to support data quality and data governance.

  • Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers (Data Science, Data Analytics teams)

  • Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team.

  • Be a problem solver; when presented with new challenges, you are expected to research and network to find solutions.

  • Seek out answers to business problems and look for opportunities to automate processes & optimize Cost.

  • Engage with and understand our customers, forming relationships that allow us to understand and prioritize both innovative new offerings and incremental platform improvements.

Basic Requirements

  • At least 7 years of data engineering experience developing large data pipelines.

  • Strong hands-on Experience with Cloud technologies like AWS (S3, EMR, EC2) and building data pipelines.

  • Strong algorithmic problem-solving expertise

  • Strong SQL skills and ability to create queries to extract data, build performant datasets and perform Data Analysis.

  • Strong Hands-on experience with distributed systems such as Spark, Pyspark to query and process data.

  • Strong fundamental Python programming skills.

  • Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines with Databricks.

  • Demonstrated competency in data modeling and analysis techniques.

  • Strong attention to detail and excellent analytical skills

  • Verbal and written communication skills and ability to collaborate with others effectively.

Preferred Qualifications

  • Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query)

  • Experience in Data Modeling techniques and Data Warehousing standard methodologies and practices

  • Experience with Software Application development.

  • Good data acumen to understand domain /functional knowledge and to be able to articulate analysis of data points in business context for stakeholders.

  • Demonstrated excellent interpersonal skills, communication skills including ability to partner with others and build consensus in a cross-functional team toward a desired outcome.

  • Experience working with a test first mentality.

  • Deep Understanding of AWS or other cloud providers as well as infrastructure as code

  • Familiar with Scrum and Agile methodologies

Required Education

  • Bachelor’s degree in computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience

Additional Information

#DISNEYTECH


The hiring range for this position in Santa Monica, California is $152,200 to $204,100 per year, in Bristol, Connecticut is $152,200 to $204,100 per year, in Seattle, Washington is $159,500 to $213,900 per year. in New York City, NY is $159,500 to $213,900 per year, and in San Francisco, California is $166,800 to $223,600 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Similar Jobs

Trendyol - Backend Developer

Trendyol

Ankara, Ankara, Türkiye (Hybrid)
3 Months ago
Playrix - Senior Engineering Manager

Playrix

Cyprus (Remote)
3 Months ago
Playrix - Senior Engineering Manager

Playrix

Almaty, Almaty Region, Kazakhstan (Remote)
3 Months ago
Unity - Senior Data Developer

Unity

Montreal, Quebec, Canada (On-Site)
4 Months ago
PlayStation Global - Manager - Data Engineering

PlayStation Global

Berlin, Berlin, Germany (Remote)
2 Months ago
CloudHire - GCP Data Engineer

CloudHire

Pune, Maharashtra, India (On-Site)
3 Months ago
Tripledot Studios - Senior Data Engineer

Tripledot Studios

Barcelona, Catalonia, Spain (On-Site)
1 Week ago
Luxoft - Regular Data Engineer

Luxoft

(Remote)
2 Months ago
Rush Street Interactive - Risk & Payment Analyst

Rush Street Interactive

Collingswood, New Jersey, United States (On-Site)
1 Month ago
Keywords Studios (Player Support) - Data Insights Lead - Player Engagement (Quality)

Keywords Studios (Player Support)

Pasig, Metro Manila, Philippines (Hybrid)
3 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Epic Games - Senior Marketing Performance Manager

Epic Games

London, England, United Kingdom (On-Site)
1 Month ago
Playrix - Director of Engineering

Playrix

Montenegro (Remote)
3 Months ago
The Walt Disney Company - Senior Software Engineer, Machine Learning - Ad Platforms

The Walt Disney Company

Seattle, Washington, United States (On-Site)
2 Months ago
Netflix - Data Engineer (L5) - Product (Device)

Netflix

United States (Remote)
3 Months ago
Career Stone Consultant - Manager - Data Engineer

Career Stone Consultant

Gurugram, Haryana, India (On-Site)
4 Months ago
PwC - Deals - Roma - Manager - Transaction Services [DLS]

PwC

Rome, Lazio, Italy (On-Site)
4 Months ago
Evolution - Scala Spark Developer

Evolution

Riga, Latvia (Hybrid)
8 Months ago
NinjaVan - Staff Data Engineer

NinjaVan

Hyderabad, Telangana, India (On-Site)
3 Months ago
Nielsen Holdings - Senior Software Engineer - Bigdata (Java/Scala , Spark, Python, AWS )

Nielsen Holdings

Gurugram, Haryana, India (Hybrid)
3 Months ago
PwC - (Senior) Manager Executive Reward

PwC

Amsterdam, North Holland, Netherlands (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Washington, United States

ByteDance - Backend Software Engineer - Security Engineering

ByteDance

San Jose, California, United States (On-Site)
17 Hours ago
Google - Software Engineer III, Google Cloud Compute Infrastructure

Google

Sunnyvale, California, United States (On-Site)
3 Months ago
Go Fund Me - Staff Software Engineer (Backend)

Go Fund Me

San Francisco, California, United States (Hybrid)
1 Month ago
Mattel  Inc  - Sr Development Program Management Associate

Mattel Inc

California, United States (On-Site)
2 Months ago
Second Dinner - Mid II Producer, Design/Gameplay

Second Dinner

United States (Remote)
6 Days ago
Epic Games - Data Analyst - Product Analytics

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
Trek - Assistant Store Manager

Trek

Broomfield, Colorado, United States (On-Site)
1 Month ago
PlayStation Global - Manager, Software Engineering

PlayStation Global

Madison, Wisconsin, United States (On-Site)
2 Months ago
Netflix - Product Manager, Media Production Algorithms

Netflix

Los Angeles, California, United States (Hybrid)
1 Month ago
Evolution - Studio Support Specialist

Evolution

Fairfield, Connecticut, United States (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Next Level Business Services - Data Scientist -  Full Time Only

Next Level Business Services

Redmond, Washington, United States (On-Site)
3 Months ago
Fortis Games - Analyst, People Analytics & Systems

Fortis Games

Rio De Janeiro, Brazil (Remote)
2 Months ago
OUTFIT7 - Global Head of Brand & Franchise Management

OUTFIT7

Limassol, Limassol, Cyprus (On-Site)
3 Months ago
PwC - IN-Senior Associate_Azure Data Engineer_ Data and Analytics_Advisory_Gurugram

PwC

Gurugram, Haryana, India (On-Site)
2 Months ago
PwC - SAP-BODS-Senior Associate-Hyderabad

PwC

Hyderabad, Telangana, India (On-Site)
1 Month ago
WebFX - Technical Digital Marketer (MARTECH Implementation)

WebFX

Philippines (Remote)
2 Months ago
Nagarro - Staff Engineer

Nagarro

Sri Lanka (Remote)
3 Months ago
Zeta - Senior Business Intelligence Engineer

Zeta

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Aristocrat Gaming - DWH Engineer

Aristocrat Gaming

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

From classic animated features and exhilarating theme park attractions to cutting edge sports coverage, and the hottest shows on television, The Walt Disney Company has been making magic since 1923, creating unforgettable stories that connect with audiences around the world. And we’re just getting started!

The key to our success…. The Cast, Crew, Imagineers and Employees who honor Disney’s rich legacy by stretching the bounds of imagination to create the never-before-seen, bringing unparalleled entertainment experiences to people of all ages. Begin a career that delivers unparalleled creative content and experiences to audiences around the world and just imagine the stories you could be part of…

What is #LifeAtDisney like? It’s a series of magical moments with cast members and employees developing and telling our stories in the most innovative ways. Whether it’s a day spent as a Disney VoluntEAR, or celebrating the release of a new interactive experience, retail product or movie, our days are filled with the knowledge that we are creating entertainment experiences the whole family can enjoy. Follow @DisneyCareers on Facebook, Twitter and Instagram for a peek behind-the-curtain, and discover how you could connect to a world of stories with Disney!

Munich, Bavaria, Germany (Hybrid)

Lake Buena Vista, Florida, United States (On-Site)

Serris, Île-de-France, France (Hybrid)

Durham, North Carolina, United States (On-Site)

Celebration, Florida, United States (On-Site)

Bristol, Connecticut, United States (On-Site)

Santa Monica, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Glendale, California, United States (On-Site)

Glendale, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by The Walt Disney Company

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug