Prime Intellect logo

Prime Intellect

Member of Technical Staff - Inference

Work from home

Remote role where the employee must remain based in a particular country.

United States only

From the listing details: Residency required in United States

Employer listed it 4 months ago · Added 8 weeks ago

Listed for 111 days before it closed.

This job has closed

Prime Intellect has taken this listing down, so it is no longer accepting applications. The details below are kept for reference only.

Browse open roles

Salary

Not stated

Location

United States only

Timezone

Not stated

Contract

Full-time

Experience

Lead

Category

Software

The employer did not publish a salary, and we have too few comparable roles to estimate one.

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Not mentioned in the advert
Where you can work from
This is a hybrid position spanning cloud LLM serving, LLM inference optimization and RL systems.
Contract
Not mentioned in the advert
Experience asked for
Not mentioned in the advert
Pay
Cash Compensation Range of $150-300k with significant equity incentives

Remote flexibility

Work from home

This is a remote role, but the employee must be based in United States. It is work from home rather than work from anywhere.

What the employer says

  • Source listing states candidate location: "San Francisco, Remote"

What Nomaders makes of it

  • Residency required in United States
  • Payroll and tax are likely handled in that country only

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Experience: employer states

Written as a requirement

  • “Required Experience”

Questions worth asking: Nomaders interpretation

  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

Own Your Intelligence

Prime Intellect is building the open superintelligence stack: the infrastructure frontier AI labs build internally, made available to every ambitious AI team.

Our platform, Lab, unifies compute, environments, evaluations, secure sandboxes, high-performance training, and deployment into one full-stack system for post-training at frontier scale - from SFT and RL to tool use, agent workflows, and continuously improving production models. We are building open frontier AI: open-source models trained end to end for long-horizon tasks like autonomous research, and the full-stack platform our own research team uses to build them. The next generation of AI companies, enterprises, and research teams do not just need more GPUs. They need the ability to turn their own workflows, tools, data, and feedback loops into superintelligence they own.

Prime Intellect has raised $150M in total funding from Founders Fund, Radical Ventures, NVIDIA, and exceptional AI, infrastructure, and enterprise operators — including Andrej Karpathy, Dwarkesh Patel, and leaders and founders from Ramp, Perplexity, Harvey, Mercor, Zapier, Datadog, Cognition, OpenAI, Thinking Machines, Together AI, SemiAnalysis, LangChain, Browserbase, Cloudflare, Sierra, Databricks, Airbnb, OpenRouter, Standard Intelligence, Fleet, Core Auto, and more. We are looking for people who want to build at the intersection of frontier research, real infrastructure, and go-to-market for a category that does not fully exist yet.

Role Impact

This is a hybrid position spanning cloud LLM serving, LLM inference optimization and RL systems. You will be working on advancing our ability to evaluate and serve models trained with our RL Lab at scale. The two key areas are:

Building the infrastructure to serve LLMs efficiently at scale.

Optimization and integration of inference systems into our RL training stack.

Core Technical Responsibilities

LLM Serving

Multi‑tenant LLM Serving: Build a multi-tenant LLM serving platform that operates across our cloud GPU fleets.

GPU‑Aware Scheduling: Design placement and scheduling algorithms for heterogeneous accelerators.

Resilience & Failover: Implement multi‑region/zone failover and traffic shifting for resilience and cost control.

Autoscaling & Routing: Build autoscaling, routing, and load balancing to meet throughput/latency SLOs.

Model Distribution: Optimize model distribution and cold-start times across clusters.

Inference Optimization & Performance

Framework Development: Integrate and contribute to LLM inference frameworks such as vLLM, SGLang, TensorRT‑LLM.

Parallelism and Configuration Tuning: Optimize configurations for tensor/pipeline/expert parallelism, prefix caching, memory management and other axes for maximum performance.

End‑to‑End Performance: Profile kernels, memory bandwidth and transport; apply techniques such as quantization and speculative decoding.

Perf Suites: Develop reproducible performance suites (latency, throughput, context length, batch size, precision).

RL Integration: Embed and optimize distributed inference within our RL stack.

Platform & Tooling

CI/CD: Establish CI/CD with artifact promotion, performance gates, and reproducible builds.

Observability: Build metrics, logs, tracing; structured incident response and SLO management.

Requirements

  • ·Required Experience
  • ·Building ML Systems at Scale: 3+ years building and running large‑scale ML/LLM services with clear latency/availability SLOs.
  • ·Inference Backends: Hands‑on with at least one of vLLM, SGLang, TensorRT‑LLM.
  • ·Distributed Serving Infra: Familiarity with distributed and disaggregated serving infrastructure such as NVIDIA Dynamo.
  • ·Inference Internals: Deep understanding of prefill vs. decode, KV‑cache behavior, batching, sampling, speculative decoding, parallelism strategies.

Benefits

  • ·Cash Compensation Range of $150-300k with significant equity incentives
  • ·Flexible work arrangement (remote or San Francisco office)
  • ·Full visa sponsorship and relocation support
  • ·Professional development budget
  • ·Regular team off-sites and conference attendance

Applying

This listing has closed, so there is no application link. The details above are kept for reference only.

Found 2mo ago. Last checked 1 Nov. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Similar open jobs

Browse all open roles
Find roles that are still open

This role is closed, applications are no longer accepted.