Software Engineer, Conduit Flume Pipelines
Job Summary
Job Description
The Software Engineer will build and maintain components of a managed system for deploying, scheduling, launching, monitoring, and debugging Flume jobs. Responsibilities include delivering new features to expand Conduit Flume Pipelines' capabilities, building core orchestration libraries in C++, defining and extending public APIs in C++, Python, Java, and Go. Collaboration with infrastructure teams (Conduit, Flume, Data Engineering Console, DPPE, Table Service) is crucial for API integration, defining feature requirements, and contributing directly to their codebases. The role also involves contributing to Dreampipe to support key new use cases. Minimum qualifications include a Bachelor's degree or equivalent experience and 2 years of software development experience in languages like Ruby, Python, Java, or C++.
Must have:
- Bachelor's degree or equivalent experience
- 2+ years software development experience
- Programming experience in Ruby, Python, Java, or C++
- Build and maintain Flume job management system
- Develop and extend APIs in multiple languages
Good to have:
- Experience with Engineering Tools and Infrastructure
- Experience running and managing Flume pipelines
6 skills required
Job Details
Minimum qualifications:
- Bachelor’s degree or equivalent practical experience.
- 2 years of experience in software development in one or more general purpose programming languages.
- Experience programming in one or more of the following languages: Ruby, Python, Java, C++.
Preferred qualifications:
- Experience with Engineering Tools and Infrastructure.
- Experience in running and managing Flume pipelines.
About the job
The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.Responsibilities
- Build components of a managed system that works on deployment, scheduling, launching, monitoring, and debugging of Flume jobs.
- Deliver new features to expand the set of use cases that Conduit Flume Pipelines can serve.
- Build core orchestration libraries in C++, define and extend public APIs in C++, Python, Java and Go.
- Work with the underlying infra teams (Conduit, Flume, Data Engineering Console, DPPE, Table Service) to integrate with their APIs, define requirements for new features, and make direct code contributions to their codebases.
- Make smaller contributions to Dreampipe to continue supporting the most important new use cases.
Similar Jobs
Zoox
Foster City, California, United States (Hybrid)
• 7 Months ago
Nagarro
Bengaluru, Karnataka, India (On-Site)
• 5 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
GoTo Group
Jakarta, Jakarta, Indonesia (On-Site)
• 7 Months ago
Microsoft
Dublin, County Dublin, Ireland (On-Site)
• 5 Months ago
Duck Creek Technologies
Mumbai, Maharashtra, India (Remote)
• 7 Months ago
Industrial Scientific
Bengaluru, Karnataka, India (On-Site)
• 8 Months ago
Trendyol
İstanbul, İstanbul, Türkiye (Hybrid)
• 7 Months ago
Get notifed when new similar jobs are uploaded
Jobs in Worldwide
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Backend Development Jobs
Salesforce
Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
• 8 Months ago
GoTo Group
Jakarta, Jakarta, Indonesia (On-Site)
• 5 Months ago
CloudLinux
Podgorica Municipality, Montenegro (Remote)
• 6 Months ago
Red Rover Interactive
Newcastle Upon Tyne, England, United Kingdom (Hybrid)
• 1 Year ago
Get notifed when new similar jobs are uploaded
