Anthropic logo

Anthropic

More roles at Anthropic

Staff+ Software Engineer, Inference Velocity

Work from home

Remote role where the employee must remain based in a particular country.

United States only

From the listing details: Residency required in United States

Employer listed it 3 months ago · Added 2 months ago

Been open since 3 months ago. Long-running listings are sometimes left up after the role is filled.

Salary

$405k to $485k per year

Location

United States only

Timezone

Not stated

Contract

Full-time

Experience

Lead

Category

Software

Stated by the employer in the job description

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Where you can work from
Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time.
Contract
Not mentioned in the advert
Experience asked for
Not mentioned in the advert
Pay
The annual compensation range for this role is listed below.

Remote flexibility

Work from home

This is a remote role, but the employee must be based in United States. It is work from home rather than work from anywhere.

What the employer says

  • Source listing states candidate location: "Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY, San Francisco, CA"

What Nomaders makes of it

  • Residency required in United States
  • Payroll and tax are likely handled in that country only

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Experience: employer states

Written as a requirement

  • “Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience”
  • “Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position”

Questions worth asking: Nomaders interpretation

  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

Anthropic's Inference organization serves Claude to millions of users and enterprise customers with the speed, reliability, and efficiency that frontier AI demands. We build across GPUs, TPUs, and Trainium, and the complexity of our development environment grows with every platform we add. We're looking for a Staff engineer to be the technical lead for Inference Developer Productivity: the team that makes every engineer in the org dramatically more effective at building, testing, and shipping inference software.

This is a senior IC role with broad technical ownership. You'll set technical direction for the team's toolchains, workflows, and feedback loops, and you'll be the one making the hard calls on architecture, prioritization, and tradeoffs across heterogeneous accelerator platforms. You'll pair with the team's Engineering Manager, who owns hiring and people development, while you own the technical roadmap and drive the work. You'll also partner closely with Anthropic's central Infrastructure org, where company-wide developer productivity lives, to make sure Inference's multi-accelerator reality is well served without duplicating effort.

This role is for someone who has been the technical anchor on a platform or infrastructure team before, who thinks in systems and feedback loops, and who gets real satisfaction from the moment another engineer stops fighting their environment and starts shipping.

Key responsibilities

Set technical direction for Inference Developer Productivity, owning the architecture and roadmap for toolchains, dev environments, and CI/CD across GPU (CUDA), TPU, and Trainium platforms

Be the technical owner of accelerator toolchain management: compilers, drivers, libraries, frameworks, kept current, compatible, and well-tested so Inference engineers focus on model serving instead of environment archaeology

Design and build infrastructure for efficient accelerator usage during development, including devbox environments, pre- and post-land validation automation, and shared tooling that reduces the cost of working across heterogeneous hardware

Define and instrument productivity metrics for the Inference org, building the dashboards and alerting that surface regressions early (smoke tests red for extended periods, build times creeping up, toolchain breakages) and drive them to resolution

Proactively hunt down bottlenecks, toil, and friction across Inference engineering workflows, then design and build the systems that eliminate them

Act as the technical counterpart to Anthropic's central Infrastructure org, aligning on shared developer productivity initiatives, contributing Inference-specific requirements, and making the call on build vs. adopt

Mentor engineers on the team through design review, code review, and direct collaboration, raising the technical bar without owning headcount

Minimum qualifications

8+ years of software engineering experience, with significant time as the technical lead or anchor on an infrastructure, platform, or developer productivity team

Deep background in systems engineering, build/test infrastructure, or ML infrastructure, with the ability to go hands-on with toolchain issues, CI/CD pipelines, and developer workflow optimization

Experience owning toolchains or development environments for compute-intensive workloads (ML training or inference, HPC, large-scale distributed systems)

Real depth in at least one accelerator ecosystem (CUDA/GPU, TPU, or Trainium/AWS Neuron) and genuine appetite to learn the others

A track record of defining and using engineering metrics to drive improvement: you've built dashboards, set SLOs on developer workflows, or led initiatives that measurably improved engineering velocity

Experience driving technical alignment across organizational boundaries, advocating for your team's needs while contributing to shared infrastructure

Strong written and verbal communication, and the ability to influence technical direction without formal authority

Preferred qualifications

Experience with ML compiler toolchains (XLA, Triton, NeuronX) or accelerator driver/firmware management at scale

Requirements

  • ·8+ years of software engineering experience, with significant time as the technical lead or anchor on an infrastructure, platform, or developer productivity team
  • ·Deep background in systems engineering, build/test infrastructure, or ML infrastructure, with the ability to go hands-on with toolchain issues, CI/CD pipelines, and developer workflow optimization
  • ·Experience owning toolchains or development environments for compute-intensive workloads (ML training or inference, HPC, large-scale distributed systems)
  • ·Real depth in at least one accelerator ecosystem (CUDA/GPU, TPU, or Trainium/AWS Neuron) and genuine appetite to learn the others
  • ·A track record of defining and using engineering metrics to drive improvement: you've built dashboards, set SLOs on developer workflows, or led initiatives that measurably improved engineering velocity

Benefits

No benefits package published with this listing. Ask about it at first interview.

How to apply

  1. 1Check the flexibility label above, work from home, matches where you plan to live and work.
  2. 2Tailor your CV to the role at Anthropic, mentioning your remote working experience.
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 2mo ago. Last checked 17 Nov. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Similar roles

Other open software roles with comparable remote rules.

Browse all open roles

$405k to $485k per year · You'll be taken to the employer's careers page.