Baseten logo

Baseten

More roles at Baseten

Software Engineer - Infrastructure

Hybrid

Part remote, part office, you need to live within commuting distance of a named location.

Hybrid · San Francisco

Employer listed it 21 months ago · Added 2 months ago

Been open since 21 months ago. Long-running listings are sometimes left up after the role is filled.

Salary

$165k to $330k per year

Location

Hybrid · San Francisco

Timezone

Not stated

Contract

Full-time

Experience

Mid

Category

Software

Published by the employer

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Not mentioned in the advert
Where you can work from
Location eligibility not confirmed
Contract
Not mentioned in the advert
Experience asked for
Not mentioned in the advert
Pay
Not mentioned in the advert

Remote flexibility

Hybrid

This role is only partly remote, the employer expects time in the office around San Francisco, Remote, Toronto, New York, Montreal, Seattle, Hybrid, so you need to live within commuting distance.

What the employer says

  • Source listing states candidate location: "San Francisco, Remote, Toronto, New York, Montreal, Seattle, Hybrid"
  • Listing mentions "Hybrid"

What Nomaders makes of it

  • Not suitable if you plan to move between countries

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Experience: employer states

Written as a nice-to-have

  • “Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus”

Questions worth asking: Nomaders interpretation

  • This role involves office time, but the advert does not say how often. Ask how many days a week are expected on site.
  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

As an Infrastructure Software Engineer at Baseten, you'll build and maintain components of our ML inference platform that powers production AI applications. You'll contribute to the core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance.

EXAMPLE INITIATIVES

You'll get to work on these types of projects as part of our Infrastructure team:

Multi-cloud capacity management

Inference on B200 GPUs

Multi-node inference

Fractional H100 GPUs for efficient model serving

RESPONSIBILITIES

Develop infrastructure components for our ML inference platform using Python and Go

Implement and maintain Kubernetes deployments for model serving

Contribute to our inference orchestration layer for model deployments

Build and enhance monitoring systems for model performance metrics

Implement efficient resource management solutions for ML workloads

Support infrastructure automation to improve ML deployment workflows

Work closely with team members to implement technical solutions

Help balance performance optimization with system reliability

Participate in technical discussions around infrastructure improvements

Learn and apply infrastructure best practices

REQUIREMENTS

Bachelor's degree or higher in Computer Science or related field

Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus

Requirements

  • ·Bachelor's degree or higher in Computer Science or related field
  • ·Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus
  • ·Working knowledge of Kubernetes and containerization
  • ·Basic understanding of machine learning concepts and model serving
  • ·Familiarity with distributed systems concepts

Benefits

  • ·Competitive compensation, including meaningful equity
  • ·(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • ·Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • ·Paid parental leave
  • ·Fertility and family-building stipend through Carrot

How to apply

  1. 1Check the flexibility label above, hybrid, matches where you plan to live and work.
  2. 2Tailor your CV to the role at Baseten, mentioning your remote working experience.
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 2mo ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Similar roles

Other open software roles with comparable remote rules.

Browse all open roles

$165k to $330k per year · You'll be taken to the employer's careers page.