Cerebras logo

Cerebras

Sr./Staff TPM - Inference Capacity

Hybrid

Part remote, part office, you need to live within commuting distance of a named location.

Hybrid 路 Sunnyvale, CA

Employer listed it 5 months ago 路 Added 8 weeks ago

Listed for 122 days before it closed.

This job has closed

Cerebras has taken this listing down, so it is no longer accepting applications. The details below are kept for reference only.

Browse open roles

Salary

Not stated

Location

Hybrid 路 Sunnyvale, CA

Timezone

Not stated

Contract

Full-time

Experience

Lead

Category

Software

The employer did not publish a salary, and we have too few comparable roles to estimate one.

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Not mentioned in the advert
Where you can work from
Location eligibility not confirmed
Contract
Not mentioned in the advert
Experience asked for
Not mentioned in the advert
Pay
Not mentioned in the advert

Remote flexibility

Hybrid

This role is only partly remote, the employer expects time in the office around Sunnyvale, CA, Remote, Toronto, CAN, Hybrid, so you need to live within commuting distance.

What the employer says

  • Source listing states candidate location: "Sunnyvale, CA, Remote, Toronto, CAN, Hybrid"
  • Listing mentions "Hybrid"

What Nomaders makes of it

  • Not suitable if you plan to move between countries

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Questions worth asking: Nomaders interpretation

  • This role involves office time, but the advert does not say how often. Ask how many days a week are expected on site.
  • No pay is stated. Ask for the salary range before investing time in interviews.
  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation. Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About the role

As demand for AI continues to accelerate, intelligent capacity management becomes one of the company's most strategic challenges. Every customer commitment, model launch, and infrastructure investment depends on making the right capacity decisions at the right time.

We're looking for an experienced Technical Program Manager to lead capacity planning and fleet strategy for our Inference Service organization. This is a highly visible role working directly with Engineering, Product, Infrastructure, SRE, Operations, and executive leadership to maximize utilization of one of the world's most advanced AI inference fleets.

What you'll own

Capacity planning and forecasting . Build and maintain the 6 / 12 / 26-week rolling capacity model across every cluster. Work with product team to translate customer contracts and sales pipeline asks into capacity requirements. Forecast model replicas, system-hours, and spares by customer and by model. Reconcile against actuals weekly. Maintain the source-of-truth doc.

New Datacenter Capacity bring-up. Collaborate with datacenter infrastructure and operations teams to support new datacenter bringup and ensure production readiness. Drive engineering efforts and related automation to ensure on-time and quality delivery.

Allocation and cluster placement. Partner closely with the SRE and product team to run the weekly capacity review across different customers/models/clusters. Decide model placement and re-balancing: which customer tenants land where, which clusters absorb new launches, which freezes are in effect etc. Run the weekly capacity and utilization report for the Inference Service leadership. Post capacity allocation, drive downstream tasks w.r.t deploying models across the allocated capacity with SRE team.

Drive capacity planning tool adoption. Partner with console engineering team to drive stakeholder adoption of the inhouse built capacity planning and allocation tool, including user acceptance testing, issue resolution, tracking changes, pilot testing and deployment. In general, Contribute to the continuous process improvement and development of internal capacity management tools.

Incident tracking and postmortems. Proactively identify and mitigate capacity bottlenecks, risks, and dependencies. In case of any SLA drop due to capacity misallocations, drive related resolution and postmortem.

Key Responsibilities

Run weekly capacity planning and daily capacity and deployment tracking with Engineering, product and operations team. Own fleet utilization reporting and forecasting

Drive capacity planning for new customer deployments and major model launches

Drive continuous improvement and stakeholder adoption of new capacity management platform

Drive org level strategic initiatives related to capacity expansion, improving fleet efficiency and maximizing effective utilization of available systems

Lead planning around major infrastructure events including but not limited to new customer commits, new model releases, change to DC/cluster architecture, etc. that impacts capacity and fleet utilization. Update capacity plans and forecasts accordingly.

Maintain Jira EPICs and Confluence pages related to capacity planning, reporting and change management to ensure execution transparency across teams

Qualifications

5+ years of TPM, technical program management, or product operations experience in cloud infrastructure, large-scale ML serving, or hyperscaler capacity planning

Experience leading large cross-functional programs involving Engineering, Product, and Operations

Comfort with the inference serving stack: model replicas, batching, prefill/decode, KV cache, accelerator scheduling

Strong data fluency: SQL, Grafana, basic Python or Flux to pull your own numbers without waiting for an analyst

Track record of running a recurring cross-functional ritual involving senior engineers and LT

Direct experience with AI accelerator fleet operations such as Habana, TPU pods, Inferentia, Trainium

Requirements

  • 路5+ years of TPM, technical program management, or product operations experience in cloud infrastructure, large-scale ML serving, or hyperscaler capacity planning
  • 路Experience leading large cross-functional programs involving Engineering, Product, and Operations
  • 路Comfort with the inference serving stack: model replicas, batching, prefill/decode, KV cache, accelerator scheduling
  • 路Strong data fluency: SQL, Grafana, basic Python or Flux to pull your own numbers without waiting for an analyst
  • 路Track record of running a recurring cross-functional ritual involving senior engineers and LT

Benefits

No benefits package published with this listing. Ask about it at first interview.

Applying

This listing has closed, so there is no application link. The details above are kept for reference only.

Found 2mo ago. Last checked 2 Nov. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Find roles that are still open

This role is closed, applications are no longer accepted.