Baseten logo

Baseten

Software Engineer - Baseten Inference Stack

Hybrid

Part remote, part office, you need to live within commuting distance of a named location.

Hybrid · San Francisco

Employer listed it 6 months ago · Added 2 months ago

Listed for 125 days before it closed.

This job has closed

Baseten has taken this listing down, so it is no longer accepting applications. The details below are kept for reference only.

Browse open roles

Salary

$180,000 to $360,000

Location

Hybrid · San Francisco

Timezone

Not stated

Contract

Full-time

Experience

Mid

Category

Software

Published by the employer

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Not mentioned in the advert
Where you can work from
https://www.baseten.co/blog/how-baseten-multi-cloud-capacity-management-mcm-powers-cloud-self-hosted-and-hybr/#comparing-deployment-options-cloud-vs-self-hosted-vs-hybrid
Contract
Not mentioned in the advert
Experience asked for
Not mentioned in the advert
Pay
Not mentioned in the advert

Remote flexibility

Hybrid

This role is only partly remote, the employer expects time in the office around San Francisco, Toronto, New York, Montreal, Seattle, Hybrid, so you need to live within commuting distance.

What the employer says

  • Source listing states candidate location: "San Francisco, Toronto, New York, Montreal, Seattle, Hybrid"
  • Listing mentions "Hybrid"

What Nomaders makes of it

  • Not suitable if you plan to move between countries

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Questions worth asking: Nomaders interpretation

  • This role involves office time, but the advert does not say how often. Ask how many days a week are expected on site.
  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

Baseten’s Inference Stack team builds the distributed runtime that powers large-scale LLM inference across our platform. We operate at the intersection of distributed systems, model performance, infrastructure, and developer experience. We enable customers to deploy and operate cutting-edge LLM models with industry-leading performance, scalability, reliability, and ease of use.

As a Software Engineer on the Inference Stack team, you’ll work across the stack - from the developer experience customers use to deploy models, the libraries used for features like tool calling and reasoning, all the way down to the systems we use to orchestrate deployments in Kubernetes and route traffic efficiently.

This is an ideal role for engineers who enjoy owning systems in production, solving hard integration problems, and making complex infrastructure simple and reliable for users.

EXAMPLE INITIATIVES

Blog Posts

https://www.baseten.co/blog/nvidia-dynamo-day-baseten-inference-stack/

https://www.baseten.co/blog/how-baseten-achieved-2x-faster-inference-with-nvidia-dynamo/

https://www.baseten.co/blog/how-baseten-multi-cloud-capacity-management-mcm-powers-cloud-self-hosted-and-hybr/#comparing-deployment-options-cloud-vs-self-hosted-vs-hybrid

RESPONSIBILITIES

Develop infrastructure and orchestration systems for deploying and managing large-scale distributed LLM inference

Work across the stack, from customer-facing features to low-level infrastructure components

Build platform capabilities related to routing, autoscaling, scheduling, observability, and runtime management

Improve the reliability, scalability, and usability of our inference stack

Collaborate closely with Model Performance engineers to make new inference optimizations broadly available to customers and easy to configure

Help define best practices around testing, release automation, benchmarking, and operational excellence

Debug complex production systems spanning Kubernetes, distributed runtimes, networking, and GPU workloads

Make thoughtful engineering tradeoffs balancing performance, reliability, operational simplicity, and developer experience

Own projects end-to-end: from architecture and implementation through deployment, monitoring, and iteration based on customer feedback

REQUIREMENTS

Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or a related field

Strong background in distributed systems, backend infrastructure, or platform engineering

Requirements

  • ·Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or a related field
  • ·Strong background in distributed systems, backend infrastructure, or platform engineering
  • ·Experience building and operating production systems where reliability, latency, and scale are first-class concerns
  • ·Strong sense of developer experience: you think about how systems are used, not just how they work
  • ·Motivated and willing to learn new languages, frameworks, and systems as needed

Benefits

  • ·Competitive compensation, including meaningful equity
  • ·(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • ·Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • ·Paid parental leave
  • ·Fertility and family-building stipend through Carrot

Applying

This listing has closed, so there is no application link. The details above are kept for reference only.

Found 2mo ago. Last checked 11 Oct. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Similar open jobs

Browse all open roles
Find roles that are still open

This role is closed, applications are no longer accepted.