Cohere logo

Cohere

More roles at Cohere

Member of Technical Staff, Model Efficiency

Region Restricted

Remote work allowed only within certain countries or regions.

Employer listed it 13 months ago · Added 2 months ago

Been open since 13 months ago. Long-running listings are sometimes left up after the role is filled.

Salary

$250k to $535k per year

Location

Timezone

Not stated

Contract

Full-time

Experience

Lead

Category

Other

Published by the employer

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
We embrace a remote-friendly environment, and as part of this approach, we strategically distribute teams based on interests, expertise, and time zones to promote collaboration and flexibility.
Where you can work from
Working Location: This role can be based remotely or from one of our office locations listed on the job description - there is no minimum in-office qualification requirement.
Contract
Full-Time Employees at Cohere enjoy these Perks:
Experience asked for
5+ years of experience writing high-performance, production-quality code
Pay
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.

Remote flexibility

Region Restricted

Remote work is allowed, but only for candidates based in United States, Canada.

What the employer says

  • Source listing states candidate location: "New York, San Francisco, Toronto, Montreal, Remote"

What Nomaders makes of it

  • Applications outside the listed area are usually rejected
  • Timezone overlap with the listed area is often expected

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Experience: employer states

Written as a requirement

  • “It’s a big plus if you have experience with:”

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

Who are we?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!

Role Overview:

Our team is a fast-growing group of researchers and engineers focused on building reliable ML systems and pushing the boundaries of LLM inference efficiency. We develop techniques that improve how models execute in production, driving lower latency, higher throughput, and consistent quality across diverse workloads.

Please Note: We have offices in Toronto, Montreal, San Francisco, New York, Paris, Seoul and London. We embrace a remote-friendly environment, and as part of this approach, we strategically distribute teams based on interests, expertise, and time zones to promote collaboration and flexibility. You'll find the Model Efficiency team concentrated in the EST and PST time zones, these are our preferred locations.

Job Responsibilities:

As an engineer on this team, you’ll work across the inference stack to improve core performance metrics by diving deep into model execution, identifying bottlenecks, and developing innovative optimizations. You’ll collaborate closely with modeling and systems teams to experiment, measure, and ship improvements that meaningfully accelerate inference. As the team evolves, you’ll have opportunities to build expertise in advanced performance techniques, including GPU/CUDA optimizations, kernel-level improvements, and model execution strategies for MoE and large-scale architectures.

Qualifications:

5+ years of experience writing high-performance, production-quality code

Strong programming skills in C++ or Python (Rust/Go also welcome)

Experience working with large language models and familiarity with the LLM inference ecosystem (e.g., vLLM, SGLang, etc.)

Ability to diagnose and resolve performance bottlenecks across the model execution stack

A strong bias for action — you ship fast, measure impact, and iterate

It’s a big plus if you have experience with:

GPU programming, CUDA, or low-level systems optimization

Language modeling with transformers (MoE, speculative decoding, KV-cache optimizations)

Scaling performance-critical distributed systems (e.g., computation, search, storage)

Working Location: This role can be based remotely or from one of our office locations listed on the job description - there is no minimum in-office qualification requirement. We care most about hiring exceptional people regardless of locations, though please check the location listed on the posting for guidance around the core time zone or working hours alignment expected for the role.

Full-Time Employees at Cohere enjoy these Perks:

A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.

Full health and dental benefits, including a separate budget for mental health.

Requirements

  • ·5+ years of experience writing high-performance, production-quality code
  • ·Strong programming skills in C++ or Python (Rust/Go also welcome)
  • ·Experience working with large language models and familiarity with the LLM inference ecosystem (e.g., vLLM, SGLang, etc.)
  • ·Ability to diagnose and resolve performance bottlenecks across the model execution stack
  • ·A strong bias for action — you ship fast, measure impact, and iterate

Benefits

  • ·A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
  • ·Full health and dental benefits, including a separate budget for mental health.
  • ·RRSP matching, 401K, Pension Scheme.
  • ·100% Parental Leave top-up for up to 6 months, for either parent.
  • ·Annual enrichment benefits:

How to apply

  1. 1Check the flexibility label above, region restricted, matches where you plan to live and work.
  2. 2Tailor your CV to the role at Cohere, mentioning your remote working experience.
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 2mo ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Similar roles

Other open other roles with comparable remote rules.

Browse all open roles

$250k to $535k per year · You'll be taken to the employer's careers page.