Software Engineer, Multimedia

undefined ago • 3 Years + • Software Development & Engineering • $170,000 PA - $240,000 PA

Job Summary

Job Description

Fireworks AI is building the future of generative AI infrastructure, offering the fastest and most scalable inference platform. Funded by top investors, the team comprises veterans from PyTorch and Google Vertex AI. This role seeks a Backend Infrastructure Engineer to accelerate multimedia AI capabilities, focusing on building and optimizing infrastructure for state-of-the-art multimodal AI, including VLMs and speech AI models. The goal is to achieve industry-leading latency and throughput, develop features like VLM fine-tuning, and enable models on the latest hardware, driving ARR growth in the multimedia AI space.
Must have:
  • Collaborate with ML engineers and researchers to productionize models and support evolving multimedia capabilities
  • Identify, profile and address performance bottlenecks across the stack, from media preprocessing to vision/audio encoders to the core inference engine
  • Ensure high reliability, observability, and security across backend systems.
  • Own the enablement and optimization of new model releases, ensuring we consistently deliver the fastest implementations in the market.
  • Build and maintain performant APIs and services
  • Collaborate closely with customers and sales teams to implement custom features and optimizations that drive ARR growth
  • Propose new roadmap items based on customer needs.
Good to have:
  • Experience supporting ML workloads in production (model fine-tuning, distributed training, inference optimization)
  • Experience working directly with LLMs, vision-language models, audio models (ASR, TTS) or other multimodal AI systems in production environments
  • Experience with performance optimization and profiling for high-throughput systems
  • Knowledge of model quantization, speculative decoding, or other ML optimization techniques
Perks:
  • Meaningful equity in a fast-growing startup
  • Competitive salary
  • Comprehensive benefits package

Job Details

About Us:

Here at Fireworks, we’re building the future of generative AI infrastructure. Fireworks offers the generative AI platform with the highest-quality models and the fastest, most scalable inference. We’ve been independently benchmarked to have the fastest LLM inference and have been getting great traction with innovative research projects, like our own function calling and multi-modal models. Fireworks is funded by top investors, like Benchmark and Sequoia, and we’re an ambitious, fun team composed primarily of veterans from Pytorch and Google Vertex AI.

The Role:

We're looking for a strong Backend Infrastructure Engineer to help accelerate our multimedia AI capabilities. You'll build and optimize the infrastructure powering state-of-the-art multimodal AI including vision-language models (VLMs), and speech AI models. You'll focus on achieving industry-leading latency and throughput across diverse multimedia workloads. You'll develop infrastructure for features like VLM fine-tuning, real-time voice processing pipelines, and model enablement on the latest hardware. You'll be instrumental in helping us capture significant ARR growth in the multimedia AI space while ensuring we deliver the fastest, most reliable multimodal platform in the market.

Key Responsibilities:

  • Collaborate with ML engineers and researchers to productionize models and support evolving multimedia capabilities
  • Identify, profile and address performance bottlenecks across the stack, from media preprocessing to vision/audio encoders to the core inference engine
  • Ensure high reliability, observability, and security across backend systems.
  • Own the enablement and optimization of new model releases, ensuring we consistently deliver the fastest implementations in the market.
  • Build and maintain performant APIs and services
  • Collaborate closely with customers and sales teams to implement custom features and optimizations that drive ARR growth
  • Propose new roadmap items based on customer needs.

Minimum Qualifications:

  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience as a backend or infrastructure engineer, ideally supporting ML/AI systems or data-intensive workloads.
  • Experience with PyTorch and deep learning frameworks for inference and training.
  • Strong programming skills in Python and/or Go, with a track record of building reliable distributed backend systems.
  • Experience with cloud platforms (e.g., AWS, GCP), infrastructure-as-code tools (e.g., Terraform), and containerization/orchestration tools (e.g., Docker, Kubernetes).

Preferred Qualifications:

  • Experience supporting ML workloads in production (model fine-tuning, distributed training, inference optimization)
  • Experience working directly with LLMs, vision-language models, audio models (ASR, TTS) or other multimodal AI systems in production environments
  • Experience with performance optimization and profiling for high-throughput systems
  • Knowledge of model quantization, speculative decoding, or other ML optimization techniques

Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package. Base salary is determined by a range of factors including individual qualifications, experience, skills, interview performance, market data, and work location. The listed salary range is intended as a guideline and may be adjusted.

Base Pay Range (Plus Equity)

$170,000 - $240,000 USD

Why Fireworks AI?

  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
  • Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Redwood City, California, United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Software Development & Engineering Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Redwood City, California, United States (Hybrid)

Redwood City, California, United States (Remote)

Redwood City, California, United States (Hybrid)

Redwood City, California, United States (Hybrid)

Redwood City, California, United States (On-Site)

Redwood City, California, United States (On-Site)

New York, United States (Hybrid)

Redwood City, California, United States (On-Site)

Redwood City, California, United States (On-Site)

Redwood City, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Fireworks AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug