Software Engineer, Conduit Flume Pipelines

1 Hour ago • 2 Years + • Backend Development • Full Stack Development

About the job

Job Description

As a Software Engineer on the Conduit Flume Pipelines team, you'll build components for a managed system handling deployment, scheduling, launching, monitoring, and debugging of Flume jobs. You'll develop new features to expand Conduit Flume Pipelines' capabilities, build core orchestration libraries in C++, and define/extend public APIs in C++, Python, Java, and Go. Collaboration with infra teams (Conduit, Flume, Data Engineering Console, DPPE, Table Service) is crucial for API integration, defining feature requirements, and contributing directly to their codebases. You'll also contribute to Dreampipe to support key new use cases. This role requires a Bachelor's degree or equivalent experience and at least 2 years of software development experience.
Must have:
  • Bachelor's degree or equivalent experience
  • 2+ years software development experience
  • Proficiency in Ruby, Python, Java, or C++
  • Flume pipeline experience
  • Build and manage Flume jobs
  • Develop core orchestration libraries
Good to have:
  • Experience with Engineering Tools and Infrastructure

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 2 years of experience in software development in one or more general purpose programming languages.
  • Experience programming in one or more of the following languages: Ruby, Python, Java, C++.

Preferred qualifications:

  • Experience with Engineering Tools and Infrastructure.
  • Experience in running and managing Flume pipelines.

About the job

The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.

Responsibilities

  • Build components of a managed system that works on deployment, scheduling, launching, monitoring, and debugging of Flume jobs.
  • Deliver new features to expand the set of use cases that Conduit Flume Pipelines can serve.
  • Build core orchestration libraries in C++, define and extend public APIs in C++, Python, Java and Go.
  • Work with the underlying infra teams (Conduit, Flume, Data Engineering Console, DPPE, Table Service) to integrate with their APIs, define requirements for new features, and make direct code contributions to their codebases.
  • Make smaller contributions to Dreampipe to continue supporting the most important new use cases.
View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

Mountain View, California, United States (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

State Of Minas Gerais, Brazil (On-Site)

San Francisco, California, United States (On-Site)

Eemshaven, Groningen, Netherlands (On-Site)

Taipei City, Taiwan (On-Site)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Hyderabad, Telangana, India (On-Site)

Hyderabad, Telangana, India (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Similar Jobs

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Get notifed when new similar jobs are uploaded

Jobs in Zürich, Zurich, Switzerland

Niantic - Senior Software Engineer

Niantic, Switzerland (Hybrid)

Interactive Brokers - Institutional Client Services Associate - Italian speaking

Interactive Brokers, Switzerland (Hybrid)

PwC - Senior Manager in Insurance Consulting

PwC, Switzerland (On-Site)

Luxoft - Avaloq Developer for MS Dynamics

Luxoft, Switzerland (On-Site)

Sonar Source - Enterprise Account Manager - France & BENELUX

Sonar Source, Switzerland (On-Site)

Sonar Source - Major Account Manager - DACH

Sonar Source, Switzerland (On-Site)

Palo Alto Networks - Presales Manager - Network Security (Domain Consulting)

Palo Alto Networks, Switzerland (Remote)

Luxoft - Senior Test Automation Engineer

Luxoft, Switzerland (On-Site)

Get notifed when new similar jobs are uploaded

Backend Development Jobs

Sense - Lead Backend Engineer - II

Sense, India (On-Site)

Rush Street Interactive - Senior Server Engineer

Rush Street Interactive, Estonia (On-Site)

Velotio Technologies - Senior Engineer (Java/Scala)

Velotio Technologies, India (Remote)

Next Level Business Services - Java Developer

Next Level Business Services, United States (On-Site)

Inworld AI - Staff Software Engineer - USA

Inworld AI, United States (Remote)

Sovrun - Rust Development Lead

Sovrun, Philippines (Remote)

Get notifed when new similar jobs are uploaded