Senior Principal Data Engineer - Consumer Monetization Platform

2 Weeks ago • 7-10 Years • Data Analysis • $150,380 PA - $327,025 PA

Job Summary

Job Description

We are seeking a Senior Principal Data Engineer for the Consumer Monetization Platform team at Yahoo. This role involves working on large-scale data engineering pipelines and next-generation machine learning and AI-based data infrastructure. You will support new functionalities on existing platforms and mine data for analytics insights and product features. Responsibilities include designing, implementing, and maintaining data pipeline/analytics architectures, improving existing data infrastructures for ML/deep learning, and interacting with various teams to deliver data solutions. You will also take end-to-end ownership of ML-based distributed data systems, develop complex queries and large-volume data pipelines, and prototype new metrics or data systems. This position requires leading data investigations and maintaining released systems, with a focus on petabyte-scale data. The role offers flexible hybrid work options.
Must have:
  • BS with 10+ years or MS with 7+ years of relevant industry experience
  • Strong fundamentals in algorithms, distributed computing, data structures, and databases
  • Fluency in Go/Java/Python/C++/Scala/SQL
  • 5+ years of experience in large-scale analytics or ML systems development
  • 2+ years of experience with Google Cloud Platform services
  • 2+ years of experience with Hadoop technologies (Spark, Kafka, etc.)
  • Experience in data modeling, schema design, ETL, and data analysis
  • Self-driven, detail-oriented, good communication, and teamwork skills
Good to have:
  • Experience with machine learning algorithms, NLP, or statistical methods
  • Experience in machine learning, analytics, data mining, or data mart/warehouse
  • Experience with Deep Learning platforms (Tensorflow/Keras/Spark MLlib)
Perks:
  • Healthcare
  • 401k
  • Backup childcare
  • Education stipends
  • Incentive compensation opportunities (discretionary annual bonus or commissions)
  • Flexible hybrid work options

Job Details

Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. For advertisers, Yahoo Advertising offers omnichannel solutions and powerful data to engage with our brands and deliver results.

A Little About Us:
We are an industry leading direct to Consumer and Ad tech solution for advertisers and publishers. Our innovative Ad tech gives one stop access to Yahoo, inc. trusted data, high quality inventory and demand, creative ad experiences and industry-leading machine learning, at global scale. Consumer Monetization team’s charter is to Find, Evaluate, Build, and Scale new monetization, subscription and internal campaign tools and products, ad formats and functionalities across all Yahoo brands including Yahoo Homepage, Yahoo Sports, Yahoo Finance, Yahoo News and AOL. This team is uniquely positioned to identify growth and revenue generation opportunities, design and implement solutions across consumer products and advertising platforms including video, display, native, and search.

A Lot About You:
As part of the Consumer Monetization Platform Engineering team, you will be working on data engineering pipelines and next generation Machine Learning- and AI-based data infrastructure, supporting new functionalities on existing platforms, and mining data for analytics insights and product features.

Our Big Data footprints are among the largest few in the world, at double-digit petabyte scale. Developing this infrastructure presents many technical challenges in the areas of efficient query processing, large-scale stream processing, machine learning and modeling, as well as satisfying complex business rules.

If you are someone who is passionate about harnessing data at insane scale, enjoys working with new technologies, setting up petabyte data infrastructures and implementing new machine learning solutions and metrics systems, we want to hear from you!

Your Day

  • Responsible for designing, implementing and maintaining data pipeline/analytics architectures of Yahoo’s Consumer Monetization Platform 

  • Improve our existing data infrastructures for machine learning and deep learning using your core expertise

  • Interact with data analysts, data scientists, product managers, and software engineers to understand business problems, technical requirements to deliver data solutions

  • Work with other engineers to implement algorithms and systems in an efficient way

  • Take end to end ownership of Machine Learning-based distributed data systems - from data pipelines and training, to real time prediction engines.

  • Develop complex queries, very large volume data pipelines, and analytics applications

  • Develop complex queries and software programs to solve analytics and data mining problems

  • Prototype new metrics or data systems

  • Lead data investigations to troubleshoot data issues that arise along the data pipelines

  • Maintenance and improvement of released systems

  • Engineering consulting on large and complex warehouse data


Qualifications
BS with 10+ years of relevant Industry experience/M.S. in Computer Science with 7+ years of relevant Industry experience. Computer Science graduate ideally with specialization in Data Engineering or Machine Learning

  • Strong fundamentals: algorithms, distributed computing, data structure, database

  • Fluency with at least one of:Go/Java/Python/C++/Scala/SQL

  • 5+ years of industry experience on very large scale analytics or ML systems development

  • 2+ years of experience with Google Cloud Platform (BiqQuery, Dataproc, Composer, Dataflow, BigTable, etc.)

  • 2+ years of experience in Hadoop technologies (Map/Reduce, Pig, Hive, HBase, Spark, Kafka, Oozie, etc.)

  • Experience in data modeling, schema design, ETL, and data analysis

  • Self-driven, challenge-loving, detail oriented, teamwork spirit, excellent communication skills, ability to multitask and manage expectations

Nice to Have:

  • Experience with machine learning algorithms, NLP, and/or statistical methods a big plus

  • Experience in any of: machine learning, analytics, data mining, or data mart and warehouse

  • Experience with Deep Learning platforms (Tensorflow/Keras/Spark MLlib)

The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies; exercising sound judgment; working effectively, safely and inclusively with others; exhibiting trustworthiness and meeting expectations; and safeguarding business operations and brand integrity.

At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter!

Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (www.yahooinc.com/careers/contact-us.html) or call +1.866.772.3182. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.

We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome.

The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more.

Currently work for Yahoo? Please apply on our internal career site.

Similar Jobs

frames store - FREELANCE: VFX PRODUCERS - NEW YORK

frames store

New York, New York, United States (On-Site)
1 Year ago
ISS Stoxx - Service Improvement and Delivery Quality Associate

ISS Stoxx

Mumbai, Maharashtra, India (On-Site)
3 Months ago
digital eclipse entertainment  - Video Game Producer

digital eclipse entertainment

Emeryville, California, United States (On-Site)
3 Months ago
Qualcomm - Senior Account Manager Industrial and IOT

Qualcomm

Milan, Lombardy, Italy (On-Site)
3 Months ago
Coupa - Senior Manager, Software Engineering

Coupa

Pune, Maharashtra, India (Hybrid)
1 Month ago
Trend Micro - Data Scientist

Trend Micro

Manila, Metro Manila, Philippines (On-Site)
16 Years ago
Blenheim Chalcot India - Lead Data Engineer

Blenheim Chalcot India

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Triple dot studios - Data Operations Analyst

Triple dot studios

London, England, United Kingdom (Hybrid)
1 Month ago
DraftKings - Senior Data QA Engineer

DraftKings

Bulgaria (Remote)
3 Weeks ago
Nagarro - Senior Staff Consultant, Business Analyst

Nagarro

(On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Thales - Discipline Manager (Functional Engineering Manager)

Thales

Singapore (On-Site)
2 Months ago
Ion - Software Developer/Engineer - Graduate Development Program

Ion

Pisa, Tuscany, Italy (On-Site)
10 Months ago
Hawkeye Innovations - Match Operations Assistant

Hawkeye Innovations

Dublin, County Dublin, Ireland (On-Site)
1 Month ago
Nintendo - Compensation Analyst

Nintendo

Redmond, Washington, United States (Hybrid)
3 Months ago
London stock Exchange - Senior Engineer, Site Reliability Engineering

London stock Exchange

Colombo, Western Province, Sri Lanka (Hybrid)
1 Month ago
Enphase Energy - PLM API & VPP Product Manager

Enphase Energy

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Grammarly - FinOps Analyst

Grammarly

New York, New York, United States (Hybrid)
3 Weeks ago
Solvative - Front End Lead

Solvative

Ahmedabad, Gujarat, India (Remote)
1 Month ago
Inveniolsi - SAP TRM Senior Consultant

Inveniolsi

India (On-Site)
1 Month ago
Nexon - Manager, CRM

Nexon

El Segundo, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United States

frames store - FREELANCE: NUKE - LOS ANGELES

frames store

Los Angeles, California, United States (On-Site)
1 Year ago
CAE - Field Engineer

CAE

Fort Wayne, Indiana, United States (On-Site)
2 Weeks ago
Apple - Thermal System Quality Engineer

Apple

San Diego, California, United States (On-Site)
2 Months ago
ISG - ServiceNow Program Manager

ISG

United States (Remote)
3 Months ago
SimpliSafe - Workforce (WF) Strategy Analyst

SimpliSafe

Richmond, Virginia, United States (Hybrid)
2 Months ago
Mark43 - Talent Community

Mark43

New York, New York, United States (On-Site)
2 Weeks ago
IMC - Software Engineer

IMC

Chicago, Illinois, United States (On-Site)
3 Months ago
Propel - Staff Software Engineer (Fullstack)

Propel

New York, United States (Remote)
3 Weeks ago
cyara - Senior Enterprise Account Executive

cyara

United States (Remote)
3 Weeks ago
Decagon - Engineering Manager, Agent Software Engineering

Decagon

San Francisco, California, United States (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Square enix Japan - HR Data Scientist

Square enix Japan

Shibuya, Tokyo, Japan (On-Site)
2 Months ago
The Walt Disney Company - Associate Business Systems Analyst

The Walt Disney Company

Hong Kong (On-Site)
6 Months ago
Trek - Business Analyst (Mobile)

Trek

Haryana, India (On-Site)
5 Months ago
C3 IoT - Data Scientist / Senior Data Scientist – Optimization (Federal)

C3 IoT

Tysons, Virginia, United States (On-Site)
3 Weeks ago
The Globel Talent Co - Senior Data Analyst

The Globel Talent Co

Johannesburg, Gauteng, South Africa (Remote)
4 Months ago
Tencent - Senior Big Data Platform SRE Engineer

Tencent

Singapore (On-Site)
1 Week ago
GoTo Group - Transport Marketing Data Analyst

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
3 Months ago
Insignia consultancy services - Senior Business Analyst

Insignia consultancy services

(Remote)
11 Months ago
Next Level Business Services - Big Data Architect with IBM Big Insights

Next Level Business Services

St. Louis, Missouri, United States (Hybrid)
9 Months ago
bytedance - Research Scientist, Data Management and Security - Infrastructure System Lab

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. For advertisers, Yahoo Advertising offers omnichannel solutions and powerful data to engage with our brands and deliver results.

United States (Remote)

United States (Hybrid)

United States (Hybrid)

United States (Hybrid)

New York, New York, United States (Hybrid)

United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Yahoo

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug