Sr Cloud Data Engineer

About Yahoo

Yahoo is a global media and tech company connecting hundreds of millions of people worldwide to their passions. We provide trusted products, content, and technology spanning finance, sports, shopping, gaming, news, search, and mail. For partners, we offer a full-stack platform to amplify growth and drive meaningful connections across advertising, search, and media.

About Research

Yahoo Research is at the forefront of developing intuitive, intelligent, and forward-looking products across our brand portfolio. We harness AI and emerging technologies to shape the next generation of Yahoo, hiring world-class engineers to support our ambitious product and platform goals. Our engineers thrive in a highly collaborative environment with a strong emphasis on technical excellence and innovation. This is a unique opportunity as we reimagine the future of Search, reinventing how users find information and accomplish their goals. To achieve this vision, we are integrating new technology and expanding our infrastructure. This role demands strategic partnership, analytical thinking, exceptional planning and execution skills, ambitious innovation, an obsession with quality and user needs, a passion for solving complex problems, and the commitment to implement durable solutions quickly and effectively. If you enjoy being part of high-performing teams, this role is for you!

About You

• You have a strong background in data engineering, with a proven track record of designing and building scalable data platforms.
• You are a proactive self-starter who can take the lead on projects, sell new ideas, and drive them to completion with a high degree of autonomy.
• You have a deep understanding of data modeling principles and modern data architecture concepts.
• You are excited by the challenge of working with diverse datasets in both batch and real-time streaming modes.
• You are a strong collaborator with excellent communication skills, capable of working with both technical and non-technical stakeholders.
• A fundamental belief in leveraging AI and machine learning as a core component of every data solution, from design to implementation.

About the Role

We are seeking a Senior Data Engineer to join our team and help us build the next generation of our cloud-first data ecosystem. As a company that is seriously data-driven, we view data not just as a support function but as a core pillar of our success. This is a chance to move beyond dated technologies and take the lead in building fresh, innovative architectures in the cloud.

You will be a key part of a new initiative, migrating existing pipelines and designing new, cutting-edge data solutions from the ground up. This is a high-impact role where you will work with diverse datasets—from streaming user interactions and financial data to audience and advertisement information—to power our analytics and data reporting teams. If you are passionate about building scalable, resilient, and modern data platforms that directly influence business decisions, we want to talk to you.

What You'll Do

• Design and develop robust, scalable, and resilient data pipelines using both streaming and batch processing technologies.
• Lead the migration of legacy data pipelines to a modern, cloud-first architecture on GCP and AWS.
• Collaborate with analytics and reporting teams to understand their needs and deliver well-structured data models.
• Architect and implement a variety of data solutions, by applying concepts such as Lambda, Kappa, and streaming architectures, ETL/ELT.
• Propose, prototype, and implement new technologies and best practices to improve our data ecosystem's efficiency and reliability.
• Contribute to the full data lifecycle, from data ingestion and transformation to modeling and warehousing.
• Help define and enforce best practices for data quality, governance, and architecture.

Key Technologies

• Cloud Ecosystems: Deep expertise in GCP and/or AWS data services
• Data Warehouses / Lakehouses: Experience with modern cloud warehouses like BigQuery, Snowflake, Redshift, Databricks, or Dremio.
• Storage: Proficiency with Google Cloud Storage (GCS) and Amazon S3, Relational, Document and Wide Column Databases, columnar formats (parquet, orc, etc), schemas (avro, protocol buffers, etc), compression formats (gzip, snappy, bzip, etc.)
• Processing: Hands-on experience with distributed data processing engines such as Apache Flink, Apache Beam, Spark, or similar technologies
• Runtimes & Orchestration: Expertise in technologies like Cloud Functions, Cloud Run, Kubernetes, Dataflow, Glue, EMR, Dataproc, and orchestration tools like dbt or BigQuery Dataforms and Airflow / Cloud Workflows / Step Functions
• Streaming: exposure and practical experience with streaming platforms like Pub/Sub and Kafka

You are fluent in

• Python or Java
• SQL
• Prompt Engineering
• Unit and Integration testing
• CICD and SDLC

Growth & Culture

• Career Path: We are committed to your growth. This role offers multiple paths for advancement, including opportunities to become a Principal Engineer, a distinguished Architect, or a leader in Engineering Management.
• Innovation: We encourage a culture of innovation where your ideas can directly shape our future. We are actively exploring the latest in AI, data management, and data mesh technologies.
• Ownership: We believe in giving our engineers the freedom and support to lead. If you have a great idea, we empower you to champion it and bring it to life.

The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies; exercising sound judgment; working effectively, safely and inclusively with others; exhibiting trustworthiness and meeting expectations; and safeguarding business operations and brand integrity.

At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter!

Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (www.yahooinc.com/careers/contact-us.html) or call +1.866.772.3182. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.

We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome.