Product Manager - CoreAI
Sumo logic
Job Summary
Sumo Logic is hiring a Senior Product Manager to help shape the future of conversational AI experiences across our platform. In this role, you'll help deliver LLM-powered copilots and intelligent agents that make complex tasks easier, faster, and more context-aware for technical users. You’ll collaborate with cross-functional partners across a globally distributed team—including engineering, design, data science, and fellow product managers. You’ll help us shape our high-level strategy into shipped features that are safe, grounded, and valuable to our customers. This is a hands-on, execution-focused role for someone who thrives on shipping high-quality AI products at scale.
Must Have
- Own the entire product lifecycle for conversational copilots and agent-assist capabilities.
- Translate strategic direction into actionable PRDs, user stories, and acceptance criteria.
- Collaborate with AI/ML engineers and UX to refine prompts, improve grounding, and optimize user interactions.
- Define product strategy for agent-to-agent interactions and task orchestration.
- Contribute to evaluation framework development, including golden datasets, LLM quality scoring, and hallucination detection.
- Partner with Engineering to implement guardrails, fallbacks, and safety rules for AI outputs.
- Establish tolerance thresholds and reliability ranges for non-deterministic AI outputs.
- Monitor product KPIs like adoption, retention, fallback frequency, latency, quality scores, and usage telemetry.
- Run regular data analysis to uncover user patterns, pain points, and opportunities.
- Support beta testing, issue triaging, and customer feedback synthesis.
- Coordinate with Product Marketing and Enablement on rollout readiness.
- 4+ years in product management, ideally with AI/ML or enterprise SaaS.
- Proven track record of understanding user pain and converting feedback into hypotheses.
- Experience with AI-powered tools, LLM copilots, or conversational agent experiences.
- Familiarity with prompt engineering, grounding techniques (RAG), and LLM evaluation best practices.
- Strong SQL skills; comfortable with dashboards, retention funnels, and guardrail metrics.
- Strong track record of managing roadmaps and executing cross-functional projects.
- Self-starter who thrives in fast-paced environments.
- Excellent communication skills.
- Bachelor's degree in Computer Science, Engineering, or a related field.
Job Description
In this role, you'll help deliver LLM-powered copilots and intelligent agents that make complex tasks easier, faster, and more context-aware for technical users.
You’ll collaborate with cross-functional partners across a globally distributed team—including engineering, design, data science, and fellow product managers. You’ll help us shape our high-level strategy into shipped features that are safe, grounded, and valuable to our customers. This is a hands-on, execution-focused role for someone who thrives on shipping high-quality AI products at scale.
Responsibilities
- Own the entire product lifecycle - from research and ideation to execution, launch, and iteration for conversational copilots and agent-assist capabilities
- Translate strategic direction into actionable PRDs, user stories, and testable acceptance criteria.
- Collaborate with AI/ML engineers and UX to refine prompts, improve grounding, and optimize user interactions.
- Define product strategy for agent-to-agent interactions and task orchestration, including delegation patterns, handoff protocols, and multi-agent coordination across the platform ecosystem.
- Contribute to the development of an evaluation framework, including golden datasets, LLM quality scoring, and hallucination detection.
- Partner with Engineering to implement guardrails, fallbacks, and safety rules to ensure responsible and evidence-backed AI outputs.
- Establish tolerance thresholds and reliability ranges for non-deterministic AI outputs, defining what "good enough" means for different use cases and user contexts.
- Monitor product KPIs like adoption, retention, fallback frequency, latency, quality scores, and usage telemetry
- Run regular data analysis to uncover user patterns, pain points, and opportunities for iteration.
- Support beta testing, issue triaging, and customer feedback synthesis for continuous improvement.
- Coordinate with Product Marketing and Enablement on rollout readiness and go-to-market activities.
Required Qualifications and Skills
- 4+ years of experience in product management, ideally with exposure to AI/ML or enterprise SaaS environments.
- Proven track record of deeply understanding user pain, running discovery, and converting ambiguous feedback into structured, testable hypotheses.
- Experience working on AI-powered tools, LLM copilots, or conversational agent experiences.
- Familiarity with prompt engineering, grounding techniques (RAG), and LLM evaluation best practices (e.g. LLM as a Judge ).
- Data fluency: Strong SQL skills; comfortable with dashboards, retention funnels, guardrail metrics, and driving data-informed decisions.Strong track record of managing roadmaps and executing cross-functional projects with engineering, design, and AI teams.
- Self-starter who thrives in fast-paced environments and adapts quickly to changing priorities.
- Excellent communication skills, both written and verbal, with a proven track record of effectively engaging with customers and cross-functional teams.
- Bachelor's degree in Computer Science, Engineering, or a related field