Software Engineer, Frontier Systems

7 Hours ago • 7 Years + • $295,000 PA - $440,000 PA
System Design

Job Description

The Frontier Systems team at OpenAI is responsible for building, launching, and supporting the world's largest supercomputers used for cutting-edge model training. This role involves developing critical infrastructure to ensure these supercomputers run reliably, minimizing disruptions caused by hardware failures. Engineers on this team own their work end-to-end, focusing on root-causing system-level issues and building automation to proactively address problems at scale, thereby enabling uninterrupted AI research.
Good To Have:
  • Experience with low level details of hardware components, protocols, and associated Linux tooling (e.g., PCIe, Infiniband, networking, power management, kernel perf tuning).
  • Experience with visualization of large data centers and networks.
  • Expertise with network operations and tooling.
  • Expertise with power management and stabilization.
Must Have:
  • Own and improve the system health checks that keep our hyperscale supercomputers stable during model training.
  • Lead deep dives into hardware failures and system-level bugs to understand how things break at scale.
  • Build automation that monitors and fixes issues across thousands of machines - so researchers can keep moving without interruption.
  • 7+ years of industry experience in software engineering.
  • Proficiency with Python and shell scripting.
  • A high degree of comfort digging into noisy data with SQL, PromQL, and Pandas or any other tool necessary.
  • Experience developing reproducible analyses.
  • A balance of strengths in building and operationalizing.
Perks:
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits, such as charitable donation matching and wellness stipends

Add these skills to join the top 1% applicants for this job

game-texts
networking
linux
pandas
asana
python
sql
shell

About the Team

The Frontier Systems team at OpenAI builds, launches, and supports the largest supercomputers in the world that OpenAI uses for its most cutting edge model training.

We take data center designs, turn them into real, working systems and build any software needed for running large-scale frontier model trainings.

Our mission is to bring up, stabilize and keep these hyperscale supercomputers reliable and efficient during the training of the frontier models.

About the Role

On the Frontier Systems team, you’ll build critical infrastructure that keeps our supercomputers running reliably for cutting-edge AI research. Even a single hardware failure can derail a large-scale training run, so minimizing disruptions is core to the mission.

Engineers here own their work end-to-end and are trusted to make a real impact. This role is for someone who goes deep - who thrives on root-causing system-level issues and building automation to catch and fix problems at scale.

In this role, you will:

  • Own and improve the system health checks that keep our hyperscale supercomputers stable during model training.
  • Lead deep dives into hardware failures and system-level bugs to understand how things break at scale.
  • Build automation that monitors and fixes issues across thousands of machines - so researchers can keep moving without interruption.

You might thrive in this role if you have:

  • 7+ years of industry experience in software engineering
  • Proficiency with Python and shell scripting
  • A high degree of comfort digging into noisy data with SQL, PromQL, and Pandas or any other tool necessary
  • Experience developing reproducible analyses
  • A balance of strengths in building and operationalizing

Prior hardware expertise is not required for this role.

Bonus if you have:

  • Experience with low level details of hardware components, protocols, and associated Linux tooling (e.g., PCIe, Infiniband, networking, power management, kernel perf tuning)
  • Experience with visualization of large data centers and networks.
  • Expertise with network operations and tooling
  • Expertise with power management and stabilization

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Set alerts for more jobs like Software Engineer, Frontier Systems
Set alerts for new jobs by OpenAI
Set alerts for new System Design jobs in United States
Set alerts for new jobs in United States
Set alerts for System Design (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙