Senior Software Engineer, Data Governance AI Agent
Job Description
- Master's/PhD in CS
- Experience with LLM agents
- Generative AI application development
- Complex system design and API development
- Knowledge of metadata management, data observability, data governance, or data lineage
- 5+ years software development experience
- API development experience
- Experience with LLMs and AI
- Software testing and launching experience
- Data structures and algorithms expertise
- Lead complex projects
- Collaborate with product and UX teams
Minimum qualifications:
- Bachelor’s degree or equivalent practical experience.
- 5 years of experience with software development and API development in one or more programming languages, and with data structures/algorithms.
- 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
- Experience with Large Language Models and AI.
Preferred qualifications:
- Master's degree or PhD in Computer Science or related technical fields.
- Experience with LLM agents.
- Experience with designing and developing Generative AI applications.
- Experience with complex system design and API development.
- Knowledge of metadata management, data observability, data governance, or data lineage.
About the job
Google engineers develop the next-generation technologies that change how users connect, explore, and interact with information and one another. As a member of an extraordinarily creative, motivated and talented team, you develop new products that are used by millions of people. We need our engineers to be versatile and passionate to take on new problems as we continue to push technology forward. If you get excited about building new things and working across discipline lines, then our team might be your next career step.
The Dataplex team on Google Cloud Platform (GCP) focuses on comprehensive data governance, deeply integrated with BigQuery. They offer automated metadata harvesting, management, lineage tracking, data quality checks, and profiling. Working alongside all GCP data analytics teams, they significantly influence the BigQuery user experience.
This role centers on the Data Lineage team, which builds APIs and UIs to visualize data transformations across GCP and other platforms. Lineage is vital for debugging data pipelines, ensuring compliance, and supporting DataOps and MLOps.
You will reboot the definition and development of AI agents to revolutionize data governance experiences on GCP.
You'll take full ownership, lead the area technically, collaborate with product and UX teams, and work with related teams. Developing full-stack solutions, or coordinating with UI engineers, is essential. This involves improving data discovery, quality management, incident handling, and impact assessment of data source changes. Essentially, you will help redefine how users understand and manage their data and processing jobs, ensuring transparency and reliability.
Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.
Responsibilities
- Collaborate with Product Management and UX to define and deliver product requirements prioritizing user experience.
- Lead complex projects involving multiple engineers and teams, providing technical guidance and direction.
- Identify, recommend, and implement improvements to the shared codebase, extending technical influence beyond the immediate team.
- Design, implement, and launch new products, features, and components with a focus on product excellence, technical quality, and rapid release cycles.
- Manage project priorities and deadlines, actively participate in monitoring and debugging, and mentor team members through clear communication and support.
