Senior Software Engineer - Data Platform

2 Months ago • 5 Years + • DevOps • $138,900 PA - $203,900 PA

Job Summary

Job Description

This Senior Software Engineer role focuses on developing, scaling, and improving big data systems for query engines and advanced data formats (Spark, Flink, Hive, etc.). Responsibilities include investigating new big data technologies, building next-gen infrastructure, optimizing performance and scalability, handling architectural design considerations, advocating best practices, collaborating with other teams, and gathering requirements to support business goals. The ideal candidate will have 5+ years of experience with big data systems and a passion for open-source contributions.
Must have:
  • 5+ years of programming experience
  • Big data system expertise (Spark, Flink, Hive etc.)
  • Open-source contribution experience
  • Strong problem-solving skills
  • Excellent communication & collaboration
Good to have:
  • Experience building in-house big data infrastructure
  • Hadoop component experience (HDFS, HBase, Yarn)
  • Cloud infrastructure experience (Terraform, K8S)
  • Managing large big data clusters
  • Experience with open-source systems (HDFS, Yarn, HBase, Kubernetes)

Job Details

Job Summary:

About Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also redefining Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to improve flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

  • Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and implement groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

About the Role & Team

We are seeking a motivated and detail-oriented Senior Software Developer to join our dynamic team. The right person for this role should have proven experience with working in mission-critical infrastructure and enjoy building and maintaining large-scale data query engines with the challenge of varied requirements and large storage capabilities. If you are someone who enjoys building large-scale big data infrastructure, then this is a great role for you.

What You Will Do

  • Develop, scale, and improve in-house/cloud and open-source big data systems for query engines and advanced data format (e.g. Spark, Flink, Hive, Druid, Presto/Trino, parquet, ORC, Delta lake, Iceberg, Hudi, etc).

  • Investigate new big data technology, and apply it to the DisneyStreaming production environment

  • Build next-gen big data infrastructure with up-to-date technologies and continuously improve performance, scalability, and availability.

  • Handle architectural and design considerations to evolute the system, focusing on security, efficiency, and flexibility

  • Advocate engineering best practices, including the use of design patterns, code review, and automated unit/functional testing  

  • Work closely with other engineering teams to influence their big data system designs and optimization efforts. Foster a culture of collaboration and knowledge-sharing           

  • Collaborate with senior internal team members and external stakeholders to gather requirements and drive the implementation of big data solutions that support our business goals           

Required Qualifications & Skills

  • 5+ years of professional programming and design experience.

  • Willing to dive deep and become an expert in one or more big data systems, ready to open up code of open-source software systems to fix bugs, add new features, improve performance, and contribute back to the community.

  • With great technical passion, terrific problem-solving skills, drive for results, and the ability to work independently.

  • Good communication and collaboration skills.

Preferred Qualifications

  • Experience in building in-house big data infrastructure.

  • Experience in developing and optimizing Hadoop related components (e.g. HDFS, HBase, Yarn, Hive, Spark, Flink, Presto)

  • Demonstrated ability with cloud infrastructure technologies, including Terraform, K8S, IAM, ELB, Ranger, KMS, etc

  • Experience in managing a big data cluster with over thousands of nodes.

  • Experience with one or more open-source big data systems, including HDFS, Yarn, HBase, Kubernetes, etc. And customize at least one of the above-mentioned systems at code-level

Education

  • BS or MS degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering or comparable field of study 

Additional Information

#DISNEYTECH


The hiring range for this position in Santa Monica, CA is $138,900 - $186,200 per year, in San Francisco, CA is $152,100 - $203,900 per year, in Seattle, WA is $145,400 - $195,000 per year, and in New York, NY is $145,400 - $195,000 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Similar Jobs

Canva - Senior Software Engineer - Cloud Security & Compliance, remote across ANZ

Canva

Sydney, New South Wales, Australia (Remote)
3 Months ago
Google - Software Engineer III, Google Kubernetes Engine

Google

(On-Site)
3 Months ago
ION - Senior Security Architect

ION

Italy (On-Site)
5 Months ago
PwC - IN-Senior Associate_Full Stack Developer_Data &Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Toptracer - Senior Software Engineer

Toptracer

Stockholm, Stockholm County, Sweden (Hybrid)
19 Hours ago
Zazz - Cloud Engineer (AWS)

Zazz

(Remote)
1 Month ago
Trend Micro - Cloud Engineer (Golang/Python, Backend Focus) 雲端開發工程師

Trend Micro

Taipei City, Taiwan (On-Site)
5 Months ago
The Walt Disney Company - Manager, Database Reliability Engineering

The Walt Disney Company

Washington, United States (On-Site)
1 Week ago
Zazz - Java Developer

Zazz

(Remote)
1 Month ago
NVIDIA - Senior DevOps Engineer, Deep Learning Frameworks

NVIDIA

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Postman - Senior Software Engineer, Monetization

Postman

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Plarium - C# Developer

Plarium

Kyiv, Kyiv City, Ukraine (Remote)
1 Week ago
ION - Software Architect - Java Multi-Tenant SAAS Cloud Native

ION

Pune, Maharashtra, India (On-Site)
5 Months ago
Huuuge Games - Senior Java Software Engineer

Huuuge Games

Warsaw, Masovian Voivodeship, Poland (Hybrid)
6 Days ago
NVIDIA - Solutions Architect, Infrastructure - Research Computing

NVIDIA

Massachusetts, United States (Remote)
1 Month ago
KBG Blockchain Game Studios - DevOps (Blockchain Gaming)

KBG Blockchain Game Studios

Thành Phố Hồ Chí Minh, Vietnam (On-Site)
8 Months ago
Zuru - DevOps Specialist

Zuru

Modena, Emilia-Romagna, Italy (Hybrid)
5 Months ago
GoTo Group - Software Engineer - Foundation Security

GoTo Group

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Santa Monica, California, United States

Tencent - Tencent Cloud Technical Account Manager

Tencent

California, United States (On-Site)
1 Month ago
Backbone - Lead Product Design Engineer

Backbone

Atherton, California, United States (On-Site)
8 Months ago
NVIDIA - Senior ASIC Power Engineer

NVIDIA

Austin, Texas, United States (On-Site)
1 Month ago
Match Group - Senior ML Platform Engineer

Match Group

New York, New York, United States (Hybrid)
5 Months ago
Light Speed Studios - Senior 3D Artist

Light Speed Studios

California, United States (On-Site)
1 Month ago
Flow - Senior/Staff Backend Software Engineer

Flow

Miami, Florida, United States (Hybrid)
5 Months ago
Next Level Business Services - MDM IDQ Developer/ Solution Architect - Full Time Only

Next Level Business Services

New York, New York, United States (On-Site)
5 Months ago
undefined - Technical Consultant, West

United States (Remote)
5 Months ago
Dreamhaven - Marketing Creative Producer

Dreamhaven

Irvine, California, United States (Hybrid)
5 Days ago
Next Level Business Services - Senior Data Engineer

Next Level Business Services

Chicago, Illinois, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

N-iX - Senior DevOps Engineer

N-iX

Argentina (Remote)
1 Week ago
Larian Studios - Senior Automation Engineer

Larian Studios

Guildford, England, United Kingdom (On-Site)
1 Month ago
Escape Velocity Entertainment - Site Reliability Engineer

Escape Velocity Entertainment

(Remote)
6 Days ago
KBG Blockchain Game Studios - DevOps (Blockchain Gaming)

KBG Blockchain Game Studios

Thành Phố Hồ Chí Minh, Vietnam (On-Site)
8 Months ago
Gaming Innovation Group  - Senior Platform DevOps Engineer

Gaming Innovation Group

St. Julian's, Malta (Hybrid)
1 Week ago
NVIDIA - Senior Site Reliability Engineer - AI Research Clusters

NVIDIA

Westford, Massachusetts, United States (Hybrid)
1 Month ago
Interactive Brokers - Senior Systems Engineer- Microsoft M365/Active Directory

Interactive Brokers

Fort Lauderdale, Florida, United States (Hybrid)
5 Months ago
VGW - Senior Site Reliability Engineer

VGW

Krakow Am See, Mecklenburg-Vorpommern, Germany (On-Site)
6 Months ago
Wipro - Release Manager

Wipro

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Luxoft - Senior Software Support Engineer

Luxoft

Slovakia (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

From classic animated features and exhilarating theme park attractions to cutting edge sports coverage, and the hottest shows on television, The Walt Disney Company has been making magic since 1923, creating unforgettable stories that connect with audiences around the world. And we’re just getting started!

The key to our success…. The Cast, Crew, Imagineers and Employees who honor Disney’s rich legacy by stretching the bounds of imagination to create the never-before-seen, bringing unparalleled entertainment experiences to people of all ages. Begin a career that delivers unparalleled creative content and experiences to audiences around the world and just imagine the stories you could be part of…

What is #LifeAtDisney like? It’s a series of magical moments with cast members and employees developing and telling our stories in the most innovative ways. Whether it’s a day spent as a Disney VoluntEAR, or celebrating the release of a new interactive experience, retail product or movie, our days are filled with the knowledge that we are creating entertainment experiences the whole family can enjoy. Follow @DisneyCareers on Facebook, Twitter and Instagram for a peek behind-the-curtain, and discover how you could connect to a world of stories with Disney!

Anaheim, California, United States (On-Site)

Lake Buena Vista, Florida, United States (On-Site)

Hong Kong (On-Site)

Papenburg, Lower Saxony, Germany (On-Site)

Hong Kong (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

Île-de-France, France (On-Site)

View All Jobs

Get notified when new jobs are added by The Walt Disney Company

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug