OpenAI logo

OpenAI

More roles at OpenAI

Software Engineer, TPU Compilers

Hybrid

Part remote, part office, you need to live within commuting distance of a named location.

Hybrid · San Francisco

Employer listed it 4 weeks ago · Added 4 weeks ago

Been open since 4 weeks ago, still being checked, but it has been live a while.

Salary

$380k to $500k per year

Location

Hybrid · San Francisco

Timezone

Not stated

Contract

Full-time

Experience

Mid

Category

Software

Published by the employer

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Not mentioned in the advert
Where you can work from
Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco…
Contract
Not mentioned in the advert
Experience asked for
Not mentioned in the advert
Pay
Not mentioned in the advert

Remote flexibility

Hybrid

This role is only partly remote, the employer expects time in the office around San Francisco, Hybrid, so you need to live within commuting distance.

What the employer says

  • Source listing states candidate location: "San Francisco, Hybrid"
  • Listing mentions "Hybrid"

What Nomaders makes of it

  • Not suitable if you plan to move between countries

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Experience: employer states

Written as a requirement

  • “AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.”

Questions worth asking: Nomaders interpretation

  • This role involves office time, but the advert does not say how often. Ask how many days a week are expected on site.
  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

About the Team

Our Inference team brings OpenAI’s most capable research and technology to the world through our products. We empower consumers, enterprises and developers alike to use and access our state-of-the-art AI models, allowing them to do things that they’ve never been able to before. We focus on performant and efficient model inference, as well as accelerating research progression via model inference.

About the Role

We’re looking for an engineer to lead the optimization of OpenAI’s state-of-the-art frontier models on TPUs. You will own performance across the full forward pass, from model code through kernels to execution on the hardware.

You’ll have broad technical ownership: identifying performance bottlenecks, choosing the most impactful improvements, and carrying them through implementation and validation. We welcome experience gained through either training or inference, with a strong foundation in optimizing real workloads on TPUs.

In this role, you will:

Optimize model execution on TPUs, improving performance across the complete forward pass and the interactions between model code, kernels, and hardware.

Profile workloads, identify bottlenecks, and implement improvements to latency, throughput, and hardware utilization.

Develop and optimize kernels, using an understanding of the surrounding model to guide implementation choices.

Explore techniques such as quantization to improve inference efficiency while preserving model quality.

Build benchmarks and tools to measure performance, validate correctness, and guide optimization work.

Partner with researchers and engineers to support new model architectures and bring performance improvements into production.

You might thrive in this role if you:

Have practical experience optimizing machine learning workloads on TPUs, through training, inference, or both.

Understand modern model architectures and how their computation maps onto accelerator hardware.

Can connect detailed kernel behavior to the performance of a complete model and work across these layers of the stack.

Bring strong software engineering skills and a systematic approach to profiling, debugging, and validating performance improvements.

Take ownership of open-ended technical problems and can identify priorities, make design decisions, and deliver working solutions.

Enjoys collaborating with researchers and engineers, learning unfamiliar parts of a system, and communicating technical tradeoffs.

Have experience with quantization or attention kernels, which would be especially useful in this role.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement .

Requirements

The employer hasn't listed requirements separately, they're described in the role summary above and on the original listing.

Benefits

No benefits package published with this listing. Ask about it at first interview.

How to apply

  1. 1Check the flexibility label above, hybrid, matches where you plan to live and work.
  2. 2Tailor your CV to the role at OpenAI, mentioning your remote working experience.
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 27d ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

$380k to $500k per year · You'll be taken to the employer's careers page.