Principal Software Engineer - Large Scale Distributed Systems & Data Platform

5 Months ago • 10-15 Years • Backend Development • Full Stack Development

Job Summary

Job Description

Warner Bros. Discovery seeks a Principal Software Engineer to architect and scale the global data platform for their streaming app, Max, and other initiatives. This role involves designing cloud infrastructure, data and analytics tools, data collection and processing technologies, ensuring security and governance, and enabling data access. Responsibilities include owning the platform's architecture, collaborating with engineers, creating user-friendly tools and frameworks, implementing AI/ML techniques, managing 24/7 support and budget, promoting innovation, and mentoring engineers. The ideal candidate has 10+ years' experience in large-scale data processing pipelines, big data technologies (Hadoop, Spark, Kafka, etc.), real-time data processing, cloud services (AWS preferred), and AI/ML.
Must have:
  • 15+ years general-purpose programming experience
  • 12+ years building complex software systems
  • 10+ years experience with big data technologies (Hadoop, Spark)
  • 10+ years real-time data processing experience
  • 10+ years cloud-based data solutions experience (AWS preferred)
Good to have:
  • Experience with AI/ML driven platforms
  • Experience with Analytics Tools (Looker, Tableau)
  • Open-source contributions

Job Details

Welcome to Warner Bros. Discovery… the stuff dreams are made of.

Who We Are…

When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life, the creators bringing them to your living rooms and the dreamers creating what’s next…

From brilliant creatives, to technology trailblazers, across the globe, WBD offers career defining opportunities, thoughtfully curated benefits, and the tools to explore and grow into your best selves. Here you are supported, here you are celebrated, here you can thrive.


Warner Bros. has been entertaining audiences for more than 90 years through the world’s most-loved characters and franchises. Warner Bros. employs people all over the world in a wide variety of disciplines. We're always on the lookout for energetic, creative people to join our team.

Your New Role

We are looking for a passionate Principal Software Engineer (Large Scale Distributed Systems & Data Platform) to help architect and scale the global data platform systems and services for our new global streaming app, Max, as well as any streaming and non-streaming initiatives within the company. This role is truly exceptional, as you will own the technical aspect of a comprehensive, worldwide, multi-tenant, multi-cloud data platform. This encompasses everything from designing a cloud infrastructure, data and analytics tools and frameworks, data collection and processing technologies, ensuring security, upholding governance, maintaining data quality, and enabling data access for all.

As the most senior technical member in the team, you will champion innovation through prototyping, development, experimentation, and seamless integration into production. You will strike the perfect balance between swiftly iterating on features and constructing a cohesive array of platforms and tools, which will empower us to navigate swiftly and decisively into the future

Your Role Accountabilities

  • Own the end-to-end architecture of the data platform, ensuring its efficiency, cost-effectiveness, security, and governance.

  • Collaborate closely with other engineers to design and build an optimal and cost-efficient platform solution.

  • Work in partnership with other engineers and managers to design and develop foundational elements of the platform. Create tools and frameworks that enhance data processing, information retrieval, governance, and data quality in a cost-effective and user-friendly manner.

  • Develop platform tools and frameworks to the same standard as seen in open-source projects. Engage closely with the engineering community and open-source them upon reaching maturity.

  • Implement cutting-edge AI/ML techniques, including Generative AI, to boost the efficiency of the platform and data engineering processes.

  • Take on the responsibility for the platform's 24x7 support availability and oversee budgetary concerns, including cloud expenditure.

  • Promote a culture of experimentation and data-driven innovation. Inspire and motivate through internal and external presentations and other speaking opportunities.

  • Assist in hiring, mentoring, and coaching engineers. Help build an engineering team that prioritizes empathy, diversity, and inclusion.

Qualifications and Experience

  • 15+ years of experience with general-purpose programming (e.g. Python, Java, Go), dealing with a variety of data structures, algorithms, and serialization formats

  • 12+ years of commendable track record of delivering complex software engineering systems and platforms.

  • 12+ years of building and maintaining Tier-1 (require 24*7 uptime and strict SLA) data driven applications.

  • 10+ years of relevant experience in designing and implementing large-scale data processing pipelines

  • 10+ years of proficiency in big data technologies such as Apache Hadoop, Apache Spark and other distributed computing frameworks such as Apache Spark, Kafka, Airflow, Kubernetes, Cassandra, Druid, Snowflake and more

  • 10+ years of experience designing and implementing real-time data processing pipelines and streaming data processing technologies such as Apache Kafka and Apache Flink

  • 10+ years of experience to design and implement data solutions using cloud-based services, including storage, compute, and analytics tools. In-depth knowledge of cloud platforms like AWS, Google Cloud or Azure

  • 5+ years of Cloud (AWS preferred) experience.

  • Experience in building AI/ML driven platform is a huge plus

  • Experience in Analytics Tools and Frameworks (such as Looker, Tableau or similar) or building native web and mobile applications (ReactiveJS or similar ) is a huge plus.

  • Priority will be given to applicants with prior open-source contributions.

Characteristics and Traits

  • Naturally inquisitive, critical thinker, proactive problem-solver, and detail-oriented.

  • Positive attitude and an open mind

  • Strong organizational skills with the ability to act independently and responsibly

  • Self-starter, comfortable initiating projects from design to execution with minimal supervision

  • Ability to manage and balance multiple (and sometimes competing) priorities in a fast-paced, complex business environment and can manage time effectively to consistently meet deadlines

  • Team player and relationship builder

#Li-hybrid

How We Get Things Done…

This last bit is probably the most important! Here at WBD, our guiding principles are the core values by which we operate and are central to how we get things done. You can find them at   along with some insights from the team on what they mean and how they show up in their day to day. We hope they resonate with you and look forward to discussing them during your interview.

Championing Inclusion at WBD

Warner Bros. Discovery embraces the opportunity to build a workforce that reflects the diversity of our society and the world around us. Being an equal opportunity employer means that we take seriously our responsibility to consider qualified candidates on the basis of merit, regardless of sex, gender identity, ethnicity, age, sexual orientation, religion or belief, marital status, pregnancy, parenthood, disability or any other category protected by law.If you’re a qualified candidate and you require adjustments or accommodations to search for a job opening or apply for a position, please contact us at recruitadmin@wbd.com.

Similar Jobs

Egnyte - Lead Technical Consultant, Professional Services

Egnyte

India (Remote)
4 Months ago
The Walt Disney Company - Senior Software Engineer - Data Platform

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Months ago
The Walt Disney Company - Senior Software Development in Test Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
2 Months ago
On Location - Data Engineering Manager

On Location

New York, New York, United States (Remote)
2 Months ago
CloudHire - Backend Developer

CloudHire

Mumbai, Maharashtra, India (Remote)
6 Months ago
The Walt Disney Company - Principal Online Services Developer

The Walt Disney Company

Sweden (Remote)
4 Months ago
DraftKings - Software Engineering Manager, Backend

DraftKings

Canada (Remote)
2 Months ago
Microsoft - (Senior) Software Engineer

Microsoft

(On-Site)
3 Months ago
Epic Games - Senior Data Scientist

Epic Games

(On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

OKX - Data Engineer

OKX

Hong Kong (On-Site)
6 Months ago
Match Group - Sr. Software Engineer, Machine Learning Infrastructure

Match Group

Palo Alto, California, United States (Hybrid)
6 Months ago
PwC - Senior Associate_Azure Data Enginer_Advisory Corporate_Advisory_Bangalore Millenia

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Ness Digital - Big Data Engineer

Ness Digital

Timișoara, Timiș, Romania (Remote)
2 Months ago
Paypal - Senior AI Machine Learning Engineer

Paypal

San Jose, California, United States (On-Site)
6 Months ago
PwC - AWS Data Architect Senior Manager

PwC

Toronto, Ontario, Canada (On-Site)
6 Months ago
Zoox - Senior/ Staff Software Engineer - Simulation Workload Orchestration

Zoox

Foster City, California, United States (Hybrid)
6 Months ago
PwC - Manager_ Cloud Architecture _ Advisory corporate _ Advisory _Hyderabad

PwC

Hyderabad, Telangana, India (On-Site)
5 Months ago
Next Level Business Services - Sr. Big Data Engineer in San Francisco, CA  / McLean, VA

Next Level Business Services

San Francisco, California, United States (On-Site)
6 Months ago
Egnyte - Senior Product Marketing Manager, Life Sciences

Egnyte

Mountain View, California, United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Hyderabad, Telangana, India

Antarctica Global - Research & Sustainability Analyst

Antarctica Global

Mumbai, Maharashtra, India (Remote)
6 Months ago
PwC - SAP BTP Consultant -Senior Associate

PwC

Ahmedabad, Gujarat, India (On-Site)
6 Months ago
PwC - Associate-SAP FICO-Kolkata-RDC

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
NVIDIA - Senior Software Aerial Performance Engineer

NVIDIA

Bengaluru, Karnataka, India (On-Site)
3 Months ago
PrashantAdvait Foundation (Acharya Prashant) - Senior iOS App Developer

PrashantAdvait Foundation (Acharya Prashant)

Noida, Uttar Pradesh, India (On-Site)
6 Months ago
Infoblox - Business Strategy and Pricing Manager

Infoblox

Pune, Maharashtra, India (Hybrid)
5 Months ago
BigShip - Software Tester

BigShip

Dehradun, Uttarakhand, India (On-Site)
6 Months ago
LogicMonitor - Staff Penetration Testing Engineer

LogicMonitor

Pune, Maharashtra, India (Hybrid)
5 Months ago
Dream Sports - Director - DevOps

Dream Sports

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Gunjan App Studios - Game Artist

Gunjan App Studios

Kolkata, West Bengal, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Backend Development Jobs

Sporty Group - Technical Director

Sporty Group

(Remote)
4 Months ago
Hedra - Full-Stack Engineer

Hedra

New York, New York, United States (On-Site)
7 Months ago
SLAY - Backend Engineer

SLAY

Berlin, Berlin, Germany (On-Site)
1 Month ago
Tencent - 41299-服务器性能测试工程师(北京)

Tencent

Beijing, Beijing, China (On-Site)
8 Months ago
Epic Games - Technical Director, Machine Learning Programmer

Epic Games

(On-Site)
2 Months ago
Canva - Backend Software Engineer - Internationalization

Canva

Beijing, Beijing, China (Remote)
1 Month ago
Xsolla - Metasites Team Lead

Xsolla

State Of São Paulo, Brazil (Remote)
3 Months ago
Huuuge Games - Senior Java Software Engineer

Huuuge Games

Masovian Voivodeship, Poland (Hybrid)
2 Months ago
ESL FACEIT Group - EFG - Senior Software Engineer - Backend (Go)

ESL FACEIT Group - EFG

London, England, United Kingdom (Remote)
5 Months ago
Tencent - Site Reliability Engineer Intern

Tencent

Los Angeles, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Warner Bros. Discovery, a premier global media and entertainment company, offers audiences the world’s most differentiated and complete portfolio of content, brands and franchises across television, film, streaming and gaming. The new company combines WarnerMedia’s premium entertainment, sports and news assets with Discovery’s leading non-fiction and international entertainment and sports businesses.

Masovian Voivodeship, Poland (Hybrid)

View All Jobs

Get notified when new jobs are added by Warner Bros. Discovery

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug