Principal Data Engineer

1 Month ago • 8 Years + • Data Analysis • $143,625 PA - $310,000 PA

Job Summary

Job Description

The Principal Data Engineer at Yahoo will be responsible for defining the technical architecture roadmap for user data platforms, driving innovation across multiple engineering teams, designing distributed data systems, and establishing standards for data quality and security. The role involves leading resolution of complex technical challenges, representing technical considerations in executive-level discussions, and mentoring senior engineers. The engineer will also be expected to lead technical evaluation of potential acquisitions and anticipate emerging technology trends. This role requires a strong understanding of system design, backend development, and experience with large-scale analytics or data processing systems.
Must have:
  • 8+ years of software engineering experience, with strong emphasis on system design and backend development
  • 3+ years of experience developing large-scale analytics or data processing systems
  • 2+ years hands-on experience with Google Cloud Platform or AWS equivalent
  • 2+ years working with Hadoop technologies and distributed computing frameworks
  • Proven track record implementing and optimizing data pipelines
  • Expert-level fundamentals: algorithms, distributed computing, data structures, database architecture
  • Advanced proficiency in at least one object-oriented programming language among Java, Python, or Scala
  • Experience leading technical teams and mentoring junior engineers
Good to have:
  • Experience with audience segmentation or personalization technologies is a plus
Perks:
  • Comprehensive benefits including healthcare
  • 401k
  • Backup childcare
  • Education stipends
  • Flexible hybrid work options

Job Details

Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. For advertisers, Yahoo Advertising offers omnichannel solutions and powerful data to engage with our brands and deliver results.

It takes powerful technology to connect our brands and partners with an audience of nearly 900 million. Whether you're designing groundbreaking architecture for mobile apps, leading the evolution of our massive ad tech stacks, or pioneering algorithms to process trillions of data points a day, what you do here will have a transformative impact on our business—and the world. Want in?

A Little About Us:

The Yahoo! Consumer Data Team is developing a unified, cloud-native platform for all Yahoo user data. We simplify how teams access and utilize Yahoo first-party and third-party data while strengthening compliance. Our work empowers business units to enhance experimentation, monetization, marketing, and personalization with greater efficiency and reduced risk.

A Little About You:

The ideal candidate will have a proven track record in engineering roles, particularly in large organizations, with a strong ability to handle complex data challenges. They should be passionate about leveraging data to drive business outcomes and possess excellent collaboration skills to work effectively across teams.

As part of our Audience Platform, you'll play a key role in helping Yahoo leverage first-party and third-party data to build comprehensive audience solutions essential for experimentation, monetization, marketing, and personalization. This large-scale initiative offers you the chance to tackle significant technical challenges while making impactful contributions to how we responsibly utilize data assets across our ecosystem.

Responsibilities:

  • Strategic Vision: Define the technical architecture roadmap for User Data platforms that aligns with Yahoo's long-term business objectives

  • Cross-Organization Leadership: Drive innovation initiatives that span multiple engineering teams and technical domains

  • System Architecture: Design distributed data systems that process billions of events daily with industry-leading performance metrics

  • Technical Governance: Establish enterprise-wide standards for data quality, security, and compliance

  • Innovation Leadership: Pioneer next-generation data processing capabilities that deliver competitive advantages in user personalization

  • Performance Engineering: Create frameworks and methodologies that systematically improve platform scalability and efficiency

  • Critical Problem Resolution: Lead resolution of complex technical challenges that have organization-wide impact

  • Executive Communication: Effectively represent technical considerations in executive-level strategy discussions

  • Talent Development: Mentor senior engineers and technical leads to build organizational technical depth

  • Industry Influence: Represent Yahoo in technical conferences and industry forums as a thought leader

  • Technical Due Diligence: Lead technical evaluation of potential acquisitions, partnerships, and major technology investments

  • Technology Strategy: Anticipate emerging technology trends and guide Yahoo's technical positioning

Requirements:

  • 8+ years of software engineering experience, with strong emphasis on system design and backend development

  • 3+ years of experience developing large-scale analytics or data processing systems for enterprise applications

  • 2+ years hands-on experience with Google Cloud Platform ecosystem (BigQuery, Dataproc, Composer, Dataflow) or AWS equivalent

  • 2+ years working with Hadoop technologies and distributed computing frameworks (Spark, Kafka, Hive)

  • Proven track record implementing and optimizing data pipelines that process terabyte-scale datasets

  • Expert-level fundamentals: algorithms, distributed computing, data structures, database architecture

  • Advanced proficiency in at least one object-oriented programming language among Java, Python, or Scala, with demonstrated ability to architect complex applications and data systems. Strong SQL expertise for sophisticated data operations

  • Experience leading technical teams and mentoring junior engineers

  • Experience with audience segmentation or personalization technologies is a plus

The material job duties and responsibilities of this role include those listed above, as well as adhering to Yahoo policies, exercising sound judgment, working effectively, safely, and inclusively with others, exhibiting trustworthiness, and meeting expectations. Additionally, it involves safeguarding business operations and brand integrity.

At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, don't hesitate to ask the recruiter!

Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider qualified applicants with criminal histories for employment in a manner consistent with applicable law. Yahoo is committed to creating an accessible environment for all candidates during the application process and for employees throughout their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (www.yahooinc.com/careers/contact-us.html) or call +1.866.772.3182. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.

We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome.

The compensation for this position ranges from $143,625.00 - $299,375.00/yr and will vary depending on factors such as your location, skills and experience.The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more.

Currently work for Yahoo? Please apply on our internal career site.

Similar Jobs

Palo Alto Networks - Business Development, Insurance Channel

Palo Alto Networks

Santa Clara, California, United States (Hybrid)
2 Months ago
Playstation - Producer, Systems Design

Playstation

Los Angeles, California, United States (On-Site)
1 Week ago
zoox - Data Scientist - Autonomy

zoox

Foster City, California, United States (Hybrid)
2 Weeks ago
Tesla - Utilities Specialist - Real Estate Operations

Tesla

Amsterdam, North Holland, Netherlands (On-Site)
4 Months ago
G5 games - Product Marketing Manager

G5 games

Tbilisi, Tbilisi, Georgia (On-Site)
2 Months ago
bytedance - Data Analyst-Workplace Service-Information System

bytedance

Dubai, Dubai, United Arab Emirates (On-Site)
7 Months ago
kaizen gaming  - BI Analyst

kaizen gaming

São Paulo, Brazil (Hybrid)
2 Weeks ago
Revolgy - Data & AI Cloud Engineer

Revolgy

London, England, United Kingdom (Remote)
1 Month ago
Capgemini - Data Business Analyst

Capgemini

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Super.com - Manager, Data Analytics

Super.com

United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Tencent - Senior Technical Artist

Tencent

(On-Site)
3 Months ago
Hitachi - Technical Consultant - F&O

Hitachi

Bangkok, Thailand (On-Site)
3 Months ago
Ansys - Senior Product Sales Manager - Cloud

Ansys

Irvine, California, United States (Remote)
1 Month ago
Trellix - Director, Technical Marketing, Network Security

Trellix

Ireland (Remote)
3 Weeks ago
Tesla - Sales Advisor

Tesla

Evenes, Nordland, Norway (On-Site)
4 Months ago
Hitachi - D365 SCM Functional Consultant

Hitachi

Pune, Maharashtra, India (Remote)
8 Months ago
Thales - Director of Production/Manufacturing and Industrialization

Thales

Ulm, Baden-Württemberg, Germany (On-Site)
1 Month ago
bytedance - LLM Global Data - LLM Safety Performance Operations Team Lead

bytedance

Singapore (On-Site)
2 Months ago
Snyk - Senior Frontend Engineer

Snyk

London, England, United Kingdom (On-Site)
1 Month ago
Workato - Senior Infrastructure Engineer (OpenSearch)

Workato

Nicosia, Nicosia, Cyprus (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in United States

Wolters Kluwer - Associate Director of Channel & Affiliates

Wolters Kluwer

Georgia, United States (Remote)
3 Weeks ago
Activision - Principal Online Programmer

Activision

Santa Monica, California, United States (On-Site)
3 Weeks ago
Thousand Eyes - Principal Software Engineer

Thousand Eyes

Austin, Texas, United States (On-Site)
1 Month ago
Netflix - HR Business Partner, Scanline/Eyeline Studios - UCAN

Netflix

Los Angeles, California, United States (On-Site)
2 Months ago
Ansys - R&D Engineer II (Meshing)

Ansys

Canonsburg, Pennsylvania, United States (On-Site)
1 Month ago
Apple - Simulation & Modeling Algorithm Engineer (iPhone)

Apple

Cupertino, California, United States (On-Site)
3 Weeks ago
HCL Tech - Senior Technical Lead

HCL Tech

Virginia, United States (On-Site)
1 Month ago
Nintendo - Ambassador - Nintendo San Francisco Store (Part-Time)

Nintendo

San Francisco, California, United States (On-Site)
7 Months ago
Apple - Business Analyst - Sports & TV+

Apple

Culver City, California, United States (On-Site)
1 Month ago
Dentsu - Senior Analyst, Analytics

Dentsu

Atlanta, Georgia, United States (Hybrid)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Varonis  - Data Analyst

Varonis

Herzliya, Tel Aviv District, Israel (Hybrid)
2 Weeks ago
Google - Software Engineer III, AI/ML GenAI, Google Cloud Data Management

Google

Sunnyvale, California, United States (On-Site)
2 Months ago
Zazz - Data Engineer

Zazz

(Remote)
5 Months ago
Apple - Data Operations Engineer - User Studies Research

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Blenheim Chalcot India - Data Scientist

Blenheim Chalcot India

Mumbai, Maharashtra, India (On-Site)
2 Weeks ago
Hasura - Software Engineer, Data Connectors (Bangalore, India)

Hasura

Bengaluru, Karnataka, India (Hybrid)
8 Months ago
Rackspace Technology - R-19462 Data Engineer III - VN

Rackspace Technology

Vietnam (Remote)
5 Months ago
Yahoo - Senior Data Engineer - Consumer Data AI / ML

Yahoo

United States (Hybrid)
1 Month ago
Tencent - Game Operations (Data Analysis Direction)

Tencent

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
Workato - Senior Java Engineer (CDC and Data Integration)

Workato

Nicosia, Nicosia, Cyprus (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. For advertisers, Yahoo Advertising offers omnichannel solutions and powerful data to engage with our brands and deliver results.

United States (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

United States (Hybrid)

United States (Hybrid)

United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Yahoo

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug