OpenAI logo

OpenAI

More roles at OpenAI

Training - Runtime Foundations Engineer

Hybrid

Part remote, part office, you need to live within commuting distance of a named location.

Hybrid · San Francisco

Employer listed it 8 months ago · Added 2 months ago

Been open since 8 months ago. Long-running listings are sometimes left up after the role is filled.

Salary

$266k to $385k per year

Location

Hybrid · San Francisco

Work style

Async

Contract

Full-time

Experience

Mid

Category

Software

Published by the employer

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
You will work primarily in Codex + Rust , building high-performance asynchronous systems with a strong emphasis on performance, correctness, resilience, and scalability.
Where you can work from
This role is based in San Francisco, CA.
Contract
Not mentioned in the advert
Experience asked for
Not mentioned in the advert
Pay
Not mentioned in the advert

Remote flexibility

Hybrid

This role is only partly remote, the employer expects time in the office around San Francisco, Hybrid, so you need to live within commuting distance.

What the employer says

  • Source listing states candidate location: "San Francisco, Hybrid"
  • Listing mentions "Hybrid"

What Nomaders makes of it

  • Not suitable if you plan to move between countries

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Experience: employer states

Written as a requirement

  • “AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.”

Questions worth asking: Nomaders interpretation

  • This role involves office time, but the advert does not say how often. Ask how many days a week are expected on site.
  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

About the Team

Training Runtime designs the core distributed runtime that powers everything from early research experiments to frontier-scale model runs. We build robust, scalable, high performance components to support our distributed training workloads. Our priorities are to maximize the productivity of our researchers and our hardware, accelerating progress towards AGI.

Within Training Runtime, the Runtime Foundations team develops the distributed OS responsible for orchestrating the large numbers of processes that make up modern training workloads and providing all necessary observability and resilience to operate in frontier scale environments. Our runtime sits beneath training frameworks and on top of research infrastructure, ensuring jobs run reliably across massive clusters while maintaining performance, stability, and observability.

Success for us is measured by both system reliability and researcher velocity - enabling ideas to scale from experiments to production training runs.

About the Role

As a Training Runtime: Runtime Foundations Engineer , you will work on the software that ties thousands of computers together and exposes them as a unified system.

This system has to serve individual researchers running multiple parallel experiments, as well as our largest training runs spanning 100’s of thousands and even millions of machines and accelerators. This requires easy to use, introspectable systems that can promote a fast debugging and development cycle, as well as relentless optimization for scale while maintaining stability and performance throughout.

You will work primarily in Codex + Rust , building high-performance asynchronous systems with a strong emphasis on performance, correctness, resilience, and scalability.

Working at this scale and at the frontier of AI development poses novel challenges. We support many different types of research, and the problems you will be working on are highly ambiguous and require a superb ability to jump into novel domains, understand user problems, and demonstrate both strong design judgment and proficient execution to advance our programs.

We’re looking for people who love optimizing an end-to-end platform, understanding high-performance architectures to maximize both local and distributed performance across our supercomputers. We’re looking for engineers excited by the rapid pace of responding to the dynamic and evolving needs of our training runtime and compute stack.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.

In this role, you will:

Work across our Python and Rust stack

Design, build, and maintain software to orchestrate and monitor machine learning workloads on our largest supercomputers

Profile and optimize our software stack to support computation orchestration at frontier scale

Improve reliability, observability, and fault tolerance for long-running jobs

Debug complex distributed systems issues across large clusters

Respond to the changing shapes and needs of the ML systems to enable our researchers

You might thrive in this role if you:

Have experience developing distributed systems

Enjoy understanding how large systems behave and fail at scale

Love being both a developer and an operator

Care deeply about performance, correctness, and reliability

Have strong software engineering skills and are proficient in Rust or another systems programming language (e.g. C++)

Requirements

The employer hasn't listed requirements separately, they're described in the role summary above and on the original listing.

Benefits

No benefits package published with this listing. Ask about it at first interview.

How to apply

  1. 1Check the flexibility label above, hybrid, matches where you plan to live and work.
  2. 2Tailor your CV to the role at OpenAI, mentioning your remote working experience and working hours (Async).
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 2mo ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Similar roles

Other open software roles with comparable remote rules.

Browse all open roles

$266k to $385k per year · You'll be taken to the employer's careers page.