Job Description
Mistral AI is seeking AI Scientists to work on pre-training and fine-tuning large language models. Responsibilities include modifying pre-trained models for human interaction, equipping them with external tool calling capabilities, and aligning models based on deployment feedback. The role also involves designing annotation processes and participating in pre-training efforts. The ideal candidate will have a strong scientific understanding of generative AI, high technical engineering competence, experience with the MLOps stack, and familiarity with AI frameworks like TensorFlow, PyTorch, or Jax. Experience with large distributed systems, self-starting, collaboration, and a low-ego mindset are essential. Audio/speech experience is a plus.
Good To Have:
- Audio/Speech experience
Must Have:
- Modify pre-trained large language models
- Equip large language models with tool calling
- Align large language models based on feedback
- Design ad-hoc annotation processes
- Participate in pre-training efforts
- High scientific understanding of generative AI
- High technical engineering competence
- Navigate MLOps technical stack
- Hands-on experience with AI frameworks
- Experience with large distributed systems
- Self-starter and autonomous
- Low-ego
- Collaborative team player mindset
Perks:
- Competitive salary and bonus structure
- Generous Equity
- Competitive Healthcare program
- 401K with 6% matching
- 18 days Paid Time Off (PTO)
- Transportation reimbursement
- Coaching via Betterup
- Gym membership reimbursement
- Meal stipend
About Mistral
At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.
We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work.
We are a dynamic, collaborative team passionate about AI and its potential to transform society.
Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited.
Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers.
Mistral AI are hiring experts in the role of pre-training and fine-tuning large language models.
What you will do
- Modifying pre-trained large language models to make them able to interact with humans
- Equipping large language models with the ability of calling external tools
- Aligning large language models based on feedback obtained during their deployment, or going through an ad-hoc annotation process
- Designing ad-hoc annotation processes themselves
- Participating to the pre-training effort.
About you
- High scientific understanding of the field of generative AI. This means a broad knowledge of the field of AI, and specific knowledge or interest in fine-tuning and using language models for applications
- High technical engineering competence. This means being able to design complex software and make them usable in production
- Be able to navigate the full MLOps technical stack, with a focus on architecture development and model evaluation and usage
- Occasionally be able to do front-end development, and have to use complex HPC infrastructure with full autonomy
- Hands-on experience with AI frameworks and tools (e.g., TensorFlow, PyTorch, Jax)
- Have experience working with large distributed systems
- Self-starter and autonomous
- Low-ego
- Collaborative and have a real team player mindset
Now, it would be ideal if you have;
- Audio/Speech experience - audio input/out, NLP etc
What We Offer
💰 Competitive salary and bonus structure
🚀 Generous Equity
🧑⚕️ Health : Competitive Healthcare program (Medical Provider: Blueshield of California 100% coverage for employee, 75% for dependents)
👴🏻 Pension : 401K (6% matching)
🏝️ PTO : 18 days
🚗 Transportation: Reimburse office parking charges, or $120/month for public transport
🤝 Coaching: we offer Betterup coaching on a voluntary basis
🏀 Sport: $120/month reimbursement for gym membership
🥕 Meal stipend: $400 monthly allowance for meals (solution might evolve as we grow bigger)
🪪 Visa sponsorship
Set alerts for more jobs like AI Scientist
Set alerts for new jobs by Mistral AI
Set alerts for new Research Development jobs in United States
Set alerts for new jobs in United States
Set alerts for Research Development (Remote) jobs
![Member of Technical Staff - RL Infrastructure [data, evals, agent]](/_next/image?url=%2Fassets%2Fimages%2Fdefault_company.png&w=96&q=75){kind=small}
