Senior Data Engineer - Consumer Data AI / ML

2 Months ago • 7 Years + • Data Analysis • $128,250 PA - $266,875 PA

Job Summary

Job Description

The ideal candidate will design, build, and optimize scalable data pipelines and infrastructure to power advanced analytics and machine learning solutions. They will collaborate with data scientists and engineers to prepare large datasets and ensure secure data flows. The role involves using cloud platforms, big data tools, and machine learning frameworks to drive AI initiatives.
Must have:
  • 7+ years of software engineering experience
  • 2+ years hands-on Google Cloud Platform experience
  • Design and maintain data pipelines for AI/ML
  • Fluency in Java, Python, or Scala is highly desirable
  • Familiarity with data security and compliance best practices

Job Details

Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. For advertisers, Yahoo Advertising offers omnichannel solutions and powerful data to engage with our brands and deliver results.

A Little About Us: 

The Yahoo! Consumer Data Team manages a petabyte warehouse to glean insights on Yahoo Media products and to improve the experience for its massive user base. The team interacts and works across multiple organizations at yahoo to grow user engagement and user experience across yahoo's product portfolio. Your work will directly influence product changes and you will work with some of the brightest engineers you have known to improve the user experience on yahoo properties and contribute to company growth. Along the way, you will solve problems for an Internet Pioneer that is hard to match in the industry.
 

Summary:

The ideal candidate will have strong AI/ML experience to design, build, and optimize scalable data pipelines and infrastructure that power advanced analytics and machine learning solutions. In this role, you will collaborate closely with data scientists, software engineers, and business stakeholders to prepare and transform large datasets, support end-to-end model development and deployment, and ensure robust, efficient, and secure data flows. You will leverage your expertise in cloud platforms, big data tools, and machine learning frameworks to drive innovation and deliver actionable insights that advance our organization’s AI initiatives and business objectives.

Responsibilities:

  • Design, build, and maintain scalable data pipelines and ETL processes to support machine learning and AI initiatives on Google Cloud Platform (GCP).

  • Implement and optimize data storage solutions using GCP services such as BigQuery, Cloud Storage, and Dataflow.

  • Ensure data quality, integrity, and security throughout the data lifecycle.

  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights.

  • Monitor, troubleshoot, and maintain the health and performance of cloud-based data infrastructure.

  • Automate manual processes and repetitive tasks to improve efficiency and reduce errors.

  • Apply data governance and compliance best practices to protect sensitive information and meet regulatory standards.

  • Stay current with new GCP features, tools, and best practices to continuously enhance data management capabilities.

  • Document solutions, processes, and architectural decisions to facilitate knowledge sharing and maintainability.

Qualifications:

  • BS or MS in Computer Science or a related major, or equivalent experience

  • 7+ years of software engineering experience, with a strong emphasis on system design and backend development.

  • 2+ years hands-on experience with Google Cloud Platform ecosystem (BigQuery, Dataproc, Composer, Dataflow, Data Catalog, Observability) or AWS equivalent.

  • Proven ability to design, build, and maintain data pipelines that support machine learning and AI model development, training, and deployment.

  • Fluency with at least one object-oriented programming language from Java, Python, or Scala is highly desirable, as these skills are critical for developing robust applications and managing data workflows effectively. SQL proficiency is also valued for database operations.

  • Familiarity with data security, compliance, and governance best practices.

  • Strong problem-solving skills, attention to detail, and ability to work collaboratively with cross-functional teams.

  • Excellent communication skills and ability to tell insightful stories using data and also manage communication within internal teams and stakeholders.

The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies; exercising sound judgment; working effectively, safely and inclusively with others; exhibiting trustworthiness and meeting expectations; and safeguarding business operations and brand integrity.

At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter!

Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (www.yahooinc.com/careers/contact-us.html) or call +1.866.772.3182. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.

We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome.

Currently work for Yahoo? Please apply on our internal career site.

Similar Jobs

pentair - Value Stream Manager - Injection Molding

pentair

Moorpark, California, United States (On-Site)
1 Year ago
Rain - Business Development Representative

Rain

(Remote)
2 Weeks ago
Reltio - Senior Product Manager - AI Agent

Reltio

Bengaluru, Karnataka, India (Hybrid)
2 Weeks ago
binance - Pioneer Talent Program - Java Engineer (Tech Compliance)

binance

Taipei City, Taiwan (Remote)
1 Month ago
Sword Health - Health Economics Sr. Analyst

Sword Health

United States (Remote)
2 Weeks ago
The Walt Disney Company - Principal Data Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
5 Months ago
The Globel Talent Co - Senior Data Analyst

The Globel Talent Co

Johannesburg, Gauteng, South Africa (Remote)
3 Months ago
Addepar - Senior Portfolio Data Engineer

Addepar

Edinburgh, Scotland, United Kingdom (On-Site)
1 Month ago
Riot Games - Principal Insights Analyst - Player Platform

Riot Games

Los Angeles, California, United States (On-Site)
8 Months ago
Ion - Senior Data Engineer, Risk Technology

Ion

New York, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Interface AI - Principal Product Manager (Sphere)

Interface AI

San Francisco, California, United States (On-Site)
2 Months ago
Magic School - Strategic Account Executive (K12 Education) - Northeast

Magic School

United States (Remote)
4 Weeks ago
Palo Alto Networks - Principal Consultant, Incident Response

Palo Alto Networks

Singapore (On-Site)
2 Weeks ago
Cognite - Senior Data Engineer

Cognite

Oslo, Oslo, Norway (Hybrid)
1 Year ago
Apple - AIML - Senior Engineering Program Manager, FM Evaluation

Apple

Cupertino, California, United States (On-Site)
3 Weeks ago
Ubisoft - Application Specialist

Ubisoft

Bucharest, Bucharest, Romania (Hybrid)
4 Months ago
IGT - IT Auditor IV

IGT

Providence, Rhode Island, United States (Hybrid)
2 Months ago
Google - Senior Software Engineer, Full Stack

Google

Mexico City, Mexico City, Mexico (On-Site)
8 Months ago
Single Store - AI & Automation Analyst

Single Store

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Survay Monkey - Vice President, Finance Operations and Accounting

Survay Monkey

Portland, Oregon, United States (Hybrid)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in United States

Interactive Brokers - Bilingual Trade Issues

Interactive Brokers

Fort Lauderdale, Florida, United States (Hybrid)
1 Month ago
Bonfire Studios - Senior Gameplay Animator

Bonfire Studios

California, United States (Hybrid)
4 Months ago
Nintendo - Buyer - Nintendo Stores

Nintendo

Redmond, Washington, United States (Hybrid)
9 Months ago
Ansys - Principal Software Engineer - User Interface

Ansys

Exton, Pennsylvania, United States (On-Site)
2 Months ago
world relief - Clinical Services Manager

world relief

Durham, North Carolina, United States (On-Site)
4 Months ago
Ion - Senior Business Consultant - Endur

Ion

Houston, Texas, United States (On-Site)
9 Months ago
Apple - SoC Silicon Debug Engineering Program Manager

Apple

Austin, Texas, United States (On-Site)
2 Months ago
C3 IoT - Director, Product Design

C3 IoT

Redwood City, California, United States (On-Site)
3 Weeks ago
AGBO - Coordinator, People & Culture

AGBO

Los Angeles, California, United States (On-Site)
2 Months ago
Interactive Brokers - Senior Software Development Engineer in Test

Interactive Brokers

Greenwich, Connecticut, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Lionbridge Games - Data Engineer I

Lionbridge Games

Mexico City, Mexico City, Mexico (On-Site)
4 Months ago
Illumina - Sr Financial Business Systems Analyst

Illumina

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Nintendo - Sr BI Data Analytics Engineer

Nintendo

Redmond, Washington, United States (On-Site)
3 Months ago
Match Group - Senior Data Analyst

Match Group

Paris, Île-de-France, France (Hybrid)
2 Weeks ago
The Mill Adventure - BI Analyst

The Mill Adventure

St. Julian's, Malta (Remote)
1 Month ago
PayPal - Manager, Data Science

PayPal

Dublin, County Dublin, Ireland (Hybrid)
1 Month ago
N-ix - Middle Data Engineer

N-ix

Poland (Hybrid)
1 Month ago
Razer - Data Analyst Intern

Razer

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
2 Months ago
Luxoft - Data Engineer (financial/investment domain)

Luxoft

Singapore, Singapore (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. For advertisers, Yahoo Advertising offers omnichannel solutions and powerful data to engage with our brands and deliver results.
View All Jobs

Get notified when new jobs are added by Yahoo

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug