Software Engineer, Deployment
Job Summary
Job Description
Mistral AI is seeking experienced backend software engineers proficient in Python, Docker, and Kubernetes to join their Engineering team. The role involves deploying and integrating AI models and APIs across various infrastructure configurations, including cloud service providers, private clouds, and on-premises solutions. You will collaborate with research, product, and solution architect teams to serve frontier models to customers. Key responsibilities include managing new model and feature releases, building and testing deployment infrastructure, ensuring AI safety on third-party platforms, maintaining high availability and performance through observability and monitoring, and optimizing resource allocation for chip usage.
Must have:
- 5+ years of relevant professional work experience
- Master's degree in Computer Science or related field
- Backend software development proficiency (Python)
- Infrastructure management proficiency (Docker, K8s)
- Good knowledge of cloud ecosystems
- Autonomous and self-starter profile
- Ability to communicate with influence
Good to have:
- CI/CD, Helm, Terraform experience
- Understanding of LLM deployment challenges
Perks:
- Competitive salary, bonus and equity structure
- Highly competitive healthcare program
- 401K (6% matching) for US-based employees
- Transportation and meal stipends
- Gym membership
- Coaching
- Visa sponsorship
6 skills required
Job Details
About Mistral
At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.
We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work.
We are a dynamic, collaborative team passionate about AI and its potential to transform society.
Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited.
Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers.
Role Summary
We are seeking experienced backend software engineers (Python, Docker, K8s) to join our Engineering team. You'll help deploy and integrate our models and APIs across multiple infrastructure configurations, from leading cloud service providers to self-hosted (private cloud and on-premises) solutions. You'll work closely with the research, product, solution architect and program management teams to serve our frontier models to customers wherever they use our technology. This position is located in our Palo Alto office.
What you will do
Key Responsibilities
As Software Engineer in the Deployment team, you will be responsible for:
• New releases – you will ensure fast and reliable launch of new models and new features to customers
• Build and test infrastructure – you will work to improve and extend the infrastructure needed to package, deploy and integrate our core technology within first-party systems and third-party platforms
• Safety – you will help solve the unique challenges that come with maintaining AI safety on third-party platforms
• Observability and Monitoring – you will collaborate closely with both internal and external stakeholders to ensure our services achieve high availability and deliver state-of-the-art performance for our users
• Resource Optimization – you will help measure and optimize the allocation of the chips that serve our models to make the best use of costly resources.
About you
• 5+ years of relevant professional work experience
• Master’s degree in Computer Science, Information Technology or a related field
• Excellent proficiency in backend software development (Python)
• Strong proficiency in infrastructure management (Docker, CI/CD, K8s, Helm, Terraform...)
• Good knowledge of cloud ecosystems and understanding of the challenges of deploying LLM in multiple environments (public cloud, private cloud, on-premises)
• Autonomous and self-starter profile
• Ability to communicate with influence
What We Offer
💰 Competitive salary, bonus and equity structure
🧑⚕️ Health : Highly competitive healthcare program
👴🏻 Pension : 401K (6% matching) for US-based employees
🧢 Transportation and meal stipends, gym membership, coaching...
🪪 Visa sponsorship
Similar Jobs
HHA Exchange
Minneapolis, Minnesota, United States (Hybrid)
• 1 Month ago
Riot Games
Shanghai, Shanghai, China (On-Site)
• 3 Months ago
dun bradstreet
Warsaw, Masovian Voivodeship, Poland (Hybrid)
• 1 Month ago
Sunnyvale, California, United States (On-Site)
• 4 Months ago
LeoVegas
Málaga, Andalusia, Spain (Hybrid)
• 5 Months ago
Electronic Arts
Vancouver, British Columbia, Canada (Hybrid)
• 4 Weeks ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Rocket
San Jose, California, United States (Remote)
• 2 Months ago
The Globel Talent Co
Johannesburg, Gauteng, South Africa (Remote)
• 2 Months ago
Open Systems Technologies
United States (Remote)
• 4 Weeks ago
Get notifed when new similar jobs are uploaded
Jobs in Palo Alto, California, United States
Alpha Sense
New York, United States (Remote)
• 1 Month ago
Figma
San Francisco, California, United States (Remote)
• 2 Weeks ago
Apple
Austin, Texas, United States (On-Site)
• 2 Months ago
Samsung Semiconductor
San Jose, California, United States (On-Site)
• 2 Months ago
Apple
San Diego, California, United States (On-Site)
• 1 Month ago
Riot Games
Los Angeles, California, United States (On-Site)
• 9 Months ago
Get notifed when new similar jobs are uploaded
Devops Jobs
flip fit
New York, United States (Remote)
• 3 Months ago
bytedance
San Jose, California, United States (On-Site)
• 9 Months ago
bytedance
Boston, Massachusetts, United States (On-Site)
• 9 Months ago
Get notifed when new similar jobs are uploaded
