Product Manager, LLM Infrastructure

2 Months ago • 4 Years + • Product Management • $130,000 PA - $175,000 PA

Job Summary

Job Description

As a Product Manager for LLM Infrastructure at Glean, you will be responsible for evaluating LLM models, developing the roadmap for Glean's LLM portfolio, managing relationships with inference and model providers, and defining product strategy for customer LLM experimentation. Your responsibilities include projecting LLM usage, cost, and capacity, as well as driving customer enablement and adoption of the latest LLMs and their native capabilities. You will spend time with customers, develop key parts of the product roadmap, empower the team, drive customer-focused decisions, and build scalable processes. This role requires you to coordinate cross-functionally with leadership, go-to-market teams, and other key stakeholders across the company.
Must have:
  • 4+ years of product management experience at SaaS companies.
  • Experience with AI/ML Ops and external-facing platform capabilities.
  • Strong technical background.
  • Excellent written and verbal communication.
  • A proven track record of delivering results.
  • Ability to collaborate with cross-functional partners.
  • A learning and growth mindset.
  • Mission-first approach.
Good to have:
  • Experience with LLMs for at-scale products.
Perks:
  • Competitive compensation
  • Medical, Vision and Dental coverage
  • Flexible work environment and time-off policy
  • 401k
  • Company events
  • A home office improvement stipend when you first join
  • Annual education stipend
  • Wellness stipend
  • Healthy lunches and dinners provided daily

Job Details

About Glean

We’re on a mission to make knowledge work faster and more humane. We believe that AI will fundamentally transform how people work. In the future, everyone will work in tandem with expert AI assistants who find knowledge, create and synthesize information, and execute work. These assistants will free people up to focus on the higher-level, creative aspects of their work.

We’re building a system of intelligence for every company in the world. On the surface, you can think of it as Google + ChatGPT for the enterprise. Under the hood, our platform is the connective tissue between AI and knowledge. It brings all of a company’s knowledge together, understands it at a deep level, provides industry-leading search relevance over it, and connects it to generative AI agents and applications.

Glean was founded by a seasoned team of former Google search and Facebook engineers who saw a need in the enterprise space for their technical depth and passion for AI. We’re a diverse team of curious and creative people who want to help each other get big things done—so we can help other teams do the same. 

We're backed by some of the Valley's leading venture capitalists—including Sequoia, Kleiner Perkins, Lightspeed, and General Catalyst—and have assembled a world-class team with senior leadership experience at Google, Slack, Facebook, Dropbox, Rubrik, Uber, Intercom, Pinterest, Palantir, and others.
 
Role

As Glean’s PM for LLM Infrastructure, you will evaluate LLM models, define the roadmap for growing Glean’s LLM portfolio, manage relationships with inference and model providers, and determine product strategy for allowing customers to experiment with different LLMs. You will own projections of LLM usage, cost, and capacity planning while driving customer enablement and their upgrade adoption journey for the latest LLMs and LLM-native capabilities.

What you will do and achieve:

  • Spending a lot of time with our customers to deeply understand their knowledge needs
  • Developing key parts of our product roadmap, marrying customers’ needs with our product vision
  • Empowering your team by giving context, setting direction, and building alignment
  • Driving customer-focused decisions, clear prioritization, and efficient execution
  • Coordinating cross-functionally with with leadership, go-to-market teams, and other key stakeholders across the company
  • Building processes that will scale as our team and company go through rapid growth

Who you are:

  • You have 4+ years of experience in product management at SaaS companies, primarily serving large enterprises with responsibilities spanning AI/ML Ops and external-facing platform capabilities.
  • Having built or worked with LLMs for at-scale products is a major plus.
  • You have a strong technical background and experience with both UX and API driven products and 3rd party product partnerships.
  • You are an excellent written and verbal communicator.
  • You have a proven track record of taking ownership, taking initiative, and delivering results.
  • You collaborate effectively with cross-functional partners.
  • You have a learning and growth mindset.
  • You are mission-first and understand that your success is measured by your product and team’s success.
  • You are an early adopter in building with or adopting AI for your own product craft and you are excited about helping customers accelerate their own AI adoption journey.

Benefits

  • Competitive compensation
  • Medical, Vision and Dental coverage
  • Flexible work environment and time-off policy
  • 401k
  • Company events
  • A home office improvement stipend when you first join
  • Annual education stipend
  • Wellness stipend
  • Healthy lunches and dinners provided daily

For California based applicants: 

The standard base salary range for this position is $130,000 - $175,000 annually. Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.

We are a diverse bunch of people and we want to continue to attract and retain a diverse range of people into our organization. We're committed to an inclusive and diverse company. We do not discriminate based on gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.

Similar Jobs

Sonar Source - Major Account Manager - DACH

Sonar Source

London, England, United Kingdom (On-Site)
7 Months ago
USE Insider - Inside Sales Specialist - Mexico

USE Insider

Mexico City, Mexico (Hybrid)
2 Months ago
Grammarly - Senior Design Manager, Growth

Grammarly

San Francisco, California, United States (Hybrid)
3 Days ago
Insight Software - Manager, Engineering

Insight Software

Hyderabad, Telangana, India (On-Site)
1 Month ago
velotio technologies  - Senior Engineer (Ruby on Rails)

velotio technologies

Pune, Maharashtra, India (Remote)
1 Month ago
submarine career - Post-Production Supervisor

submarine career

Netherlands (On-Site)
3 Months ago
GoTo Group - Product Manager - Onboarding Experience

GoTo Group

Jakarta, Indonesia (On-Site)
2 Weeks ago
Paytm - Product Operation - Assistant Manager - Lending

Paytm

Noida, Uttar Pradesh, India (On-Site)
1 Month ago
ClimateCamp - Product Management Internship

ClimateCamp

(On-Site)
1 Day ago
Justplay - Product Analyst

Justplay

Berlin, Berlin, Germany (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

C3 IoT - Solution Engineer

C3 IoT

Paris, Île-de-France, France (On-Site)
1 Week ago
Diligent Corporation - Senior Manager, Sales

Diligent Corporation

London, England, United Kingdom (Hybrid)
1 Week ago
Capgemini - Application Consultant

Capgemini

Noida, Uttar Pradesh, India (On-Site)
1 Month ago
Reltio - Staff Engineer

Reltio

Bengaluru, Karnataka, India (Remote)
2 Days ago
EveryMatrix - Senior Account Manager - Africa

EveryMatrix

Cape Town, Western Cape, South Africa (Hybrid)
2 Months ago
Temporal Technologies - Staff Solutions Architect

Temporal Technologies

Seattle, Washington, United States (On-Site)
1 Month ago
EveryMatrix - Global Sales Director

EveryMatrix

London, England, United Kingdom (Hybrid)
1 Month ago
Coupa - Regional Sales VP - Mid-Market - West

Coupa

Foster City, California, United States (Hybrid)
2 Weeks ago
Saviynt - Lead Product Owner - External

Saviynt

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Diligent Corporation - Senior Advisory Specialist - Professional Services

Diligent Corporation

Guadalajara, Jalisco, Mexico (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Palo Alto, California, United States

PermitFlow - Administrative Assistant (International)

PermitFlow

United States (Remote)
2 Days ago
Apple - Firmware Engineer – AirPods and Accessories

Apple

San Diego, California, United States (On-Site)
2 Months ago
Plaid  - Revenue Enablement Manager - New Hire Onboarding

Plaid

San Francisco, California, United States (Hybrid)
2 Weeks ago
hogarth - Commercial Finance Director

hogarth

New York, United States (Hybrid)
1 Month ago
Gloss Genius - Senior Software Engineer, Infrastructure

Gloss Genius

New York, United States (Hybrid)
2 Months ago
2K - Manager, Social & Community Marketing - Sports

2K

Austin, Texas, United States (On-Site)
1 Week ago
Apple - Silicon Failure Analysis Engineer

Apple

Austin, Texas, United States (On-Site)
2 Months ago
Grammarly - Executive Assistant to Chief Product Officer

Grammarly

San Francisco, California, United States (Hybrid)
3 Days ago
Palo Alto Networks - Business Development, Insurance Channel

Palo Alto Networks

Santa Clara, California, United States (Hybrid)
3 Months ago
Warner Bros Discovery - Lead Designer, World

Warner Bros Discovery

Salt Lake City, Utah, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Product Management Jobs

Dubit - Producer

Dubit

(On-Site)
11 Months ago
binance - Senior Product Manager - Financial Earn

binance

Taipei City, Taiwan (Remote)
6 Months ago
Bosch Group - Production Coordinator MOE1 - Temporary Position

Bosch Group

Mellansel, Västernorrland County, Sweden (On-Site)
3 Weeks ago
Apple - AI Product Manager

Apple

Cupertino, California, United States (On-Site)
2 Weeks ago
room8 - Development Production Director

room8

Poland (On-Site)
2 Months ago
Sika Group - Production Employee

Sika Group

Deventer, Overijssel, Netherlands (On-Site)
1 Month ago
Filmless - Freelance Video Producer

Filmless

New York, United States (Remote)
2 Months ago
Inkittt - Senior Product Manager, Recommendations

Inkittt

San Francisco, California, United States (On-Site)
11 Months ago
Rippling - Staff Software Engineer - Talent Products

Rippling

San Francisco, California, United States (On-Site)
7 Months ago
Marvelous games - Production Staff for Stage Performances (Live Entertainment) in the Music Video Department

Marvelous games

Shinagawa City, Tokyo, Japan (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

We’re on a mission to make knowledge work faster and more humane. We believe that AI will fundamentally transform how people work. In the future, everyone will work in tandem with expert AI assistants who find knowledge, create and synthesize information, and execute work. These assistants will free people up to focus on the higher-level, creative aspects of their work. We’re building a system of intelligence for every company in the world. On the surface, you can think of it as Google + ChatGPT for the enterprise. Under the hood, our platform is the connective tissue between AI and knowledge. It brings all of a company’s knowledge together, understands it at a deep level, provides industry-leading search relevance over it, and connects it to generative AI agents and applications.

Bengaluru, Karnataka, India (On-Site)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (On-Site)

Singapore (Remote)

Bengaluru, Karnataka, India (Hybrid)

Palo Alto, California, United States (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

New York, United States (Hybrid)

Nashville, Tennessee, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Glean

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug