Principal Software Engineer - Large Scale Distributed Systems & Data Platform

3 Months ago • 10-15 Years • Backend Development • Full Stack Development

Job Summary

Job Description

Warner Bros. Discovery seeks a Principal Software Engineer to architect and scale the global data platform for their streaming app, Max, and other initiatives. This role involves designing cloud infrastructure, data and analytics tools, data collection and processing technologies, ensuring security and governance, and enabling data access. Responsibilities include owning the platform's architecture, collaborating with engineers, creating user-friendly tools and frameworks, implementing AI/ML techniques, managing 24/7 support and budget, promoting innovation, and mentoring engineers. The ideal candidate has 10+ years' experience in large-scale data processing pipelines, big data technologies (Hadoop, Spark, Kafka, etc.), real-time data processing, cloud services (AWS preferred), and AI/ML.
Must have:
  • 15+ years general-purpose programming experience
  • 12+ years building complex software systems
  • 10+ years experience with big data technologies (Hadoop, Spark)
  • 10+ years real-time data processing experience
  • 10+ years cloud-based data solutions experience (AWS preferred)
Good to have:
  • Experience with AI/ML driven platforms
  • Experience with Analytics Tools (Looker, Tableau)
  • Open-source contributions

Job Details

Welcome to Warner Bros. Discovery… the stuff dreams are made of.

Who We Are…

When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life, the creators bringing them to your living rooms and the dreamers creating what’s next…

From brilliant creatives, to technology trailblazers, across the globe, WBD offers career defining opportunities, thoughtfully curated benefits, and the tools to explore and grow into your best selves. Here you are supported, here you are celebrated, here you can thrive.


Warner Bros. has been entertaining audiences for more than 90 years through the world’s most-loved characters and franchises. Warner Bros. employs people all over the world in a wide variety of disciplines. We're always on the lookout for energetic, creative people to join our team.

Your New Role

We are looking for a passionate Principal Software Engineer (Large Scale Distributed Systems & Data Platform) to help architect and scale the global data platform systems and services for our new global streaming app, Max, as well as any streaming and non-streaming initiatives within the company. This role is truly exceptional, as you will own the technical aspect of a comprehensive, worldwide, multi-tenant, multi-cloud data platform. This encompasses everything from designing a cloud infrastructure, data and analytics tools and frameworks, data collection and processing technologies, ensuring security, upholding governance, maintaining data quality, and enabling data access for all.

As the most senior technical member in the team, you will champion innovation through prototyping, development, experimentation, and seamless integration into production. You will strike the perfect balance between swiftly iterating on features and constructing a cohesive array of platforms and tools, which will empower us to navigate swiftly and decisively into the future

Your Role Accountabilities

  • Own the end-to-end architecture of the data platform, ensuring its efficiency, cost-effectiveness, security, and governance.

  • Collaborate closely with other engineers to design and build an optimal and cost-efficient platform solution.

  • Work in partnership with other engineers and managers to design and develop foundational elements of the platform. Create tools and frameworks that enhance data processing, information retrieval, governance, and data quality in a cost-effective and user-friendly manner.

  • Develop platform tools and frameworks to the same standard as seen in open-source projects. Engage closely with the engineering community and open-source them upon reaching maturity.

  • Implement cutting-edge AI/ML techniques, including Generative AI, to boost the efficiency of the platform and data engineering processes.

  • Take on the responsibility for the platform's 24x7 support availability and oversee budgetary concerns, including cloud expenditure.

  • Promote a culture of experimentation and data-driven innovation. Inspire and motivate through internal and external presentations and other speaking opportunities.

  • Assist in hiring, mentoring, and coaching engineers. Help build an engineering team that prioritizes empathy, diversity, and inclusion.

Qualifications and Experience

  • 15+ years of experience with general-purpose programming (e.g. Python, Java, Go), dealing with a variety of data structures, algorithms, and serialization formats

  • 12+ years of commendable track record of delivering complex software engineering systems and platforms.

  • 12+ years of building and maintaining Tier-1 (require 24*7 uptime and strict SLA) data driven applications.

  • 10+ years of relevant experience in designing and implementing large-scale data processing pipelines

  • 10+ years of proficiency in big data technologies such as Apache Hadoop, Apache Spark and other distributed computing frameworks such as Apache Spark, Kafka, Airflow, Kubernetes, Cassandra, Druid, Snowflake and more

  • 10+ years of experience designing and implementing real-time data processing pipelines and streaming data processing technologies such as Apache Kafka and Apache Flink

  • 10+ years of experience to design and implement data solutions using cloud-based services, including storage, compute, and analytics tools. In-depth knowledge of cloud platforms like AWS, Google Cloud or Azure

  • 5+ years of Cloud (AWS preferred) experience.

  • Experience in building AI/ML driven platform is a huge plus

  • Experience in Analytics Tools and Frameworks (such as Looker, Tableau or similar) or building native web and mobile applications (ReactiveJS or similar ) is a huge plus.

  • Priority will be given to applicants with prior open-source contributions.

Characteristics and Traits

  • Naturally inquisitive, critical thinker, proactive problem-solver, and detail-oriented.

  • Positive attitude and an open mind

  • Strong organizational skills with the ability to act independently and responsibly

  • Self-starter, comfortable initiating projects from design to execution with minimal supervision

  • Ability to manage and balance multiple (and sometimes competing) priorities in a fast-paced, complex business environment and can manage time effectively to consistently meet deadlines

  • Team player and relationship builder

#Li-hybrid

How We Get Things Done…

This last bit is probably the most important! Here at WBD, our guiding principles are the core values by which we operate and are central to how we get things done. You can find them at   along with some insights from the team on what they mean and how they show up in their day to day. We hope they resonate with you and look forward to discussing them during your interview.

Championing Inclusion at WBD

Warner Bros. Discovery embraces the opportunity to build a workforce that reflects the diversity of our society and the world around us. Being an equal opportunity employer means that we take seriously our responsibility to consider qualified candidates on the basis of merit, regardless of sex, gender identity, ethnicity, age, sexual orientation, religion or belief, marital status, pregnancy, parenthood, disability or any other category protected by law.If you’re a qualified candidate and you require adjustments or accommodations to search for a job opening or apply for a position, please contact us at recruitadmin@wbd.com.

Similar Jobs

Demonware - Principal Software Engineer (Distributed Systems/Data)

Demonware

Vancouver, British Columbia, Canada (On-Site)
1 Week ago
Zoox - Senior/ Staff Software Engineer - Simulation Workload Orchestration

Zoox

Foster City, California, United States (Hybrid)
4 Months ago
EXUSIA - Data Modeler / Analyst - Healthcare

EXUSIA

United States (Remote)
3 Weeks ago
GT - ML Architect (with Data Experience)

GT

Ukraine (Remote)
2 Weeks ago
Nielsen Holdings - Software Engineer ( Java , Python , SQL , AWS / Oracle)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
GoTo Group - Senior Software Engineer (IC) - SE4 (DP&I)

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
4 Months ago
Epic Games - Senior Developer Relations Engineer

Epic Games

London, England, United Kingdom (On-Site)
1 Month ago
LeoVegas - Node.js Engineer

LeoVegas

Málaga, Andalusia, Spain (On-Site)
4 Months ago
Visa - Staff Data Engineer

Visa

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Months ago
LeoVegas - Infrastructure Lead

LeoVegas

Stockholm, Stockholm County, Sweden (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

The Walt Disney Company - Sr Machine Learning Engineer

The Walt Disney Company

San Francisco, California, United States (On-Site)
2 Months ago
Zuora - Senior ML Engineer

Zuora

Chennai, Tamil Nadu, India (Hybrid)
3 Months ago
NVIDIA - Senior Data Scientist, Security and Networking Research

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Month ago
Onehouse - Data Platform Engineer (India)

Onehouse

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
5 Days ago
Egnyte - Staff Software Engineer

Egnyte

Mountain View, California, United States (Hybrid)
3 Months ago
Paypal - Lead Principal ML Engineer, AI Solutions

Paypal

San Jose, California, United States (On-Site)
4 Months ago
Egnyte - Sr. Corporate Development Analyst

Egnyte

California, United States (On-Site)
1 Month ago
Rec Room - Machine Learning Engineer

Rec Room

United States (Remote)
3 Months ago
ByteDance - Software Engineer - Data Engineering (Video Arch)

ByteDance

Singapore (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Hyderabad, Telangana, India

CloudHire - Data Labeler

CloudHire

Mumbai, Maharashtra, India (Remote)
4 Months ago
Luxoft - Murex Techno Functional Tester

Luxoft

Bengaluru, Karnataka, India (On-Site)
2 Months ago
IMAGE Creative Education - 2d Animator

IMAGE Creative Education

Chennai, Tamil Nadu, India (On-Site)
4 Months ago
Vishay Precision Group,  Inc  (VPG) - QA Engineer

Vishay Precision Group, Inc (VPG)

Chennai, Tamil Nadu, India (On-Site)
3 Months ago
PwC - IN_Senior Associate_ AWS Data Engineer_D&A_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Enphase Energy - Sr. Payroll Specialist

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Microsoft - Principal Software Engineer - Android/iOS

Microsoft

Bengaluru, Karnataka, India (On-Site)
1 Month ago
PwC - IN_Senior Associate_Azure Data Engineer _OneCloud _Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
bosh group india - SAP EWM - PUNE LOCATION

bosh group india

Maharashtra, India (On-Site)
1 Month ago
ZenElectrical - Motion and Video Designer (Marketing)

ZenElectrical

Pune, Maharashtra, India (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Backend Development Jobs

Argus Labs - Software Engineer (Junior/Fresh Graduate)

Argus Labs

Indonesia (On-Site)
6 Months ago
1047 Games - Senior Game Platform Engineer

1047 Games

(Remote)
1 Week ago
Hedra - Full-Stack Engineer

Hedra

San Francisco, California, United States (On-Site)
5 Months ago
Playnetic - Game Server Engineer - Java

Playnetic

(Remote)
6 Days ago
Playnetic - Engineering Team Lead

Playnetic

Bulgaria (Remote)
2 Months ago
Microsoft - Software Engineering Manager

Microsoft

Prague, Prague, Czechia (On-Site)
1 Month ago
Paytm - Data Engineering -Senior Data Engineer (PGDWH)

Paytm

Noida, Uttar Pradesh, India (On-Site)
2 Months ago
Jagex - Web Engineer - Project Zanaris

Jagex

Cambridge, England, United Kingdom (Remote)
2 Months ago
Moon Active - Backend Developer

Moon Active

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
2 Days ago
Devrev - Software Developer: Backend

Devrev

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Warner Bros. Discovery, a premier global media and entertainment company, offers audiences the world’s most differentiated and complete portfolio of content, brands and franchises across television, film, streaming and gaming. The new company combines WarnerMedia’s premium entertainment, sports and news assets with Discovery’s leading non-fiction and international entertainment and sports businesses.

Atlanta, Georgia, United States (On-Site)

Masovian Voivodeship, Poland (On-Site)

Washington, District Of Columbia, United States (On-Site)

Atlanta, Georgia, United States (On-Site)

Burbank, California, United States (On-Site)

London, England, United Kingdom (On-Site)

Burbank, California, United States (On-Site)

Masovian Voivodeship, Poland (On-Site)

View All Jobs

Get notified when new jobs are added by Warner Bros. Discovery

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug