Community

Home >

Jobs >

Software Engineer, Conduit Flume Pipelines

Software Engineer, Conduit Flume Pipelines

2 Weeks ago • 2 Years + • Backend Development • Full Stack Development

About the job

6 skills required for this role

Add these skills to join the top 1% applicants for this job

java

ruby

cpp

python

foundation

innovation

Job Description

The Software Engineer will build and maintain components of a managed system for deploying, scheduling, launching, monitoring, and debugging Flume jobs. Responsibilities include delivering new features to expand Conduit Flume Pipelines' capabilities, building core orchestration libraries in C++, defining and extending public APIs in C++, Python, Java, and Go. Collaboration with infrastructure teams (Conduit, Flume, Data Engineering Console, DPPE, Table Service) is crucial for API integration, defining feature requirements, and contributing directly to their codebases. The role also involves contributing to Dreampipe to support key new use cases. Minimum qualifications include a Bachelor's degree or equivalent experience and 2 years of software development experience in languages like Ruby, Python, Java, or C++.

Must have:

Bachelor's degree or equivalent experience
2+ years software development experience
Programming experience in Ruby, Python, Java, or C++
Build and maintain Flume job management system
Develop and extend APIs in multiple languages

Good to have:

Experience with Engineering Tools and Infrastructure
Experience running and managing Flume pipelines

Minimum qualifications:

Bachelor’s degree or equivalent practical experience.
2 years of experience in software development in one or more general purpose programming languages.
Experience programming in one or more of the following languages: Ruby, Python, Java, C++.

Preferred qualifications:

Experience with Engineering Tools and Infrastructure.
Experience in running and managing Flume pipelines.

About the job

The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.

Responsibilities

Build components of a managed system that works on deployment, scheduling, launching, monitoring, and debugging of Flume jobs.
Deliver new features to expand the set of use cases that Conduit Flume Pipelines can serve.
Build core orchestration libraries in C++, define and extend public APIs in C++, Python, Java and Go.
Work with the underlying infra teams (Conduit, Flume, Data Engineering Console, DPPE, Table Service) to integrate with their APIs, define requirements for new features, and make direct code contributions to their codebases.
Make smaller contributions to Dreampipe to continue supporting the most important new use cases.

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%

About The Company

Google

2598 Active Jobs

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.