Senior Staff Software Engineer - Backend Core AI

2 Hours ago • 8 Years + • Research Development • $170,000 PA - $210,000 PA

Job Summary

Job Description

interface.ai is seeking a Staff Engineer – AI Frameworks to architect and lead the development of multi-agent AI infrastructure for financial institutions. This role involves designing and scaling custom AI orchestration frameworks that integrate language models, memory, and judgment modules into trustworthy and composable autonomous systems. You will work at the intersection of machine learning, distributed systems, and agentic reasoning, bringing LLM-driven intelligence into production at scale. The focus is on building the AI runtime and execution architecture for mission-critical agents in a regulated industry, emphasizing low-latency, distributed inference systems, modular component development, and developer-facing APIs.
Must have:
  • 8+ years backend or platform engineering
  • 2+ years building AI/ML systems
  • Hands-on ML model or training pipeline experience
  • Expert LLM system design, agent architectures, RL
  • Deep Node.js, async, performance-critical backend
  • Build distributed, event-driven systems
  • Real-time inference systems with LLMs
  • Strong systems design skills
  • Lead architectural design and initiatives
Good to have:
  • Experience building multi-agent systems
  • Familiarity with vector databases
  • Comfort integrating ML eval frameworks
  • Open-source contributions to LLM tooling
Perks:
  • Medical, dental, and vision insurance
  • Wellbeing resources and programs
  • Public holidays and discretionary PTO
  • 401K
  • ESPP
  • Basic life and AD&D insurance
  • Long-term and short-term disability
  • Parental leave
  • Access to internal professional development resources

Job Details

interface.ai is the industry's-leading specialized AI provider for banks and credit unions, serving over 100 financial institutions. The company's integrated AI platform offers a unified banking experience through voice, chat, and employee-assisting solutions, enhanced by cutting-edge proprietary Generative AI.

Our mission is clear: to transform the banking experience so every consumer enjoys hyper-personalized, secure, and seamless interactions, while improving operational efficiencies and driving revenue growth.

interface.ai offers pre-trained, domain-specific AI solutions that are easy to integrate, scale, and manage, both in-branch and online. Combining this with deep industry expertise, interface.ai is the AI solution for banks and credit unions that want to deliver exceptional experiences and stay at the forefront of AI innovation.

About the Role

We’re hiring a Staff Engineer – AI Frameworks to architect and lead the development of the foundational multi-agent infrastructure powering the next generation of intelligent systems for financial institutions.

This role is not about plugging in pre-built models—it’s about designing and scaling custom AI orchestration frameworks that bind language models, memory, judgment modules, and tool use into autonomous systems that are trustworthy, composable, and policy-aligned.

You’ll work at the intersection of machine learning, distributed systems, and agentic reasoning, partnering with researchers, backend engineers, and product leaders to bring real-time, LLM-driven intelligence into production at scale.

This is a rare opportunity to define and build the AI runtime and execution architecture for mission-critical agents in a high-regulation, high-trust industry.

What You’ll Own

  • Architect a multi-agent AI framework for orchestrating LLMs, tools, memory, and decision modules in live user-facing systems

  • Build and optimize low-latency, distributed inference systems that meet real-time SLAs for transactional environments

  • Develop modular components for task planning, reward routing, fallback handling, and multi-turn reasoning

  • Design developer-facing APIs and tooling to allow AI product teams to safely extend and compose agentic functionality

  • Integrate vector stores, custom retrieval pipelines, model evaluators, judgment layers, and auto-tuning workflows

  • Drive the implementation of prompt tuning, reward modeling, and LLM-as-a-Judge techniques in production loops

  • Collaborate with research to productionize new RL, planning, or alignment strategies

  • Establish architectural best practices for extensibility, observability, and trust in AI-enabled systems

What We’re Looking For

Required Qualifications

  • 8+ years of backend or platform engineering experience, with at least 2 years building or deploying AI/ML systems

  • Prior hands-on experience building ML models or training pipelines—you know how models learn, behave, and break

  • Expert knowledge of LLM system design, agent architectures, and Reinforcement Learning techniques

  • Deep experience with Node.js, asynchronous architecture, and performance-critical backend systems

  • Proven track record building distributed, event-driven systems in high-throughput environments

  • Experience building real-time inference systems that integrate LLMs with retrieval, memory, or tool use

  • Strong systems design skills: designing modular, fault-tolerant, observable software at scale

  • Demonstrated ability to lead architectural design and cross-functional engineering initiatives

Preferred Experience

  • Experience building multi-agent systems or intelligent orchestration engines

  • Familiarity with vector databases, semantic search, and prompt engineering techniques

  • Comfort integrating ML eval frameworks and offline/online experimentation pipelines

  • Open-source contributions to LLM tooling or infrastructure a plus

What Makes This Role Special

  • You’ll define the core AI infrastructure powering autonomous financial workflows across millions of users

  • You’ll lead the engineering strategy behind multi-agent AI systems—designing how autonomous AI thinks, adapts, and acts

  • You’ll build for speed, scale, and compliance, solving real-world challenges in applied alignment, observability, and modularity

  • You’ll work with a team that combines world-class AI research, backend engineering, and product-first thinking to move fast with purpose

Compensation

Compensation is expected to be between $170,000 - $210,000. Exact compensation may vary based on skills and location.

What We Offer

  • Health: medical, dental, and vision insurance and wellbeing resources and programs
  • Time away: Public holidays and discretionary PTO package for flexible days off with manager approval
  • Financial: 401K, ESPP, Basic life and AD&D insurance, long-term and short-term disability
  • Family: parental leave
  • Development: Access to internal professional development resources.

At interface.ai, we are committed to providing an inclusive and welcoming environment for all employees and applicants. We celebrate diversity and believe it is critical to our success as a company. We do not  discriminate on the basis of race, color, religion, national origin, age, sex, gender identity, gender expression, sexual orientation, marital status, veteran status, disability status, or any other legally protected status. All employment decisions at Interface.ai are based on business needs, job requirements, and individual qualifications. We strive to create a culture that values and respects each person's unique perspective and contributions. We encourage all qualified individuals to apply for employment opportunities with Interface.ai and are committed to ensuring that our hiring process is inclusive and accessible.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in San Jose, California, United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Research Development Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Interface AI is a leading Conversational AI SaaS company focused on providing cutting-edge solutions to the financial services industry. We serve close to 100 financial institutions today. We are one of the fastest-growing AI + financial technology companies in the industry, and we were recently featured as one of the top 100 fastest-growing fintech companies in Silicon Valley. Our mission is to empower every financial institution to scale efficiently and help its customers achieve financial wellness.

San Jose, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Jose, California, United States (Remote)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

India (Remote)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Interface AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug