Snorkel AI logo

Snorkel AI

More roles at Snorkel AI

Research Scientist - RL Training

Hybrid

Part remote, part office, you need to live within commuting distance of a named location.

Hybrid · New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)

Employer listed it 6 days ago · Added 6 days ago

First listed 6 days ago and still open.

Salary

$200,000 to $375,000

Location

Hybrid · New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)

Timezone

US East

Contract

Full-time

Experience

Mid

Category

Data

Stated by the employer in the job description

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Not mentioned in the advert
Where you can work from
Location eligibility not confirmed
Contract
Not mentioned in the advert
Experience asked for
Not mentioned in the advert
Pay
Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.

Remote flexibility

Hybrid

This role is only partly remote, the employer expects time in the office around New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote), Remote, San Francisco, so you need to live within commuting distance.

What the employer says

  • Source listing states candidate location: "New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote), Remote, San Francisco"
  • Listing mentions "Hybrid"

What Nomaders makes of it

  • Not suitable if you plan to move between countries

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Experience: employer states

Written as a nice-to-have

  • “in machine learning, reinforcement learning, or a related field strongly preferred; exceptional industry experience considered.”

Questions worth asking: Nomaders interpretation

  • This role involves office time, but the advert does not say how often. Ask how many days a week are expected on site.
  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

About Snorkel

Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises to move from better data to better outcomes. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!

ABOUT THE ROLE

We are looking for a Research Scientist to advance reinforcement learning for large language models. You will develop, implement, and run training methods that help models solve frontier-level challenging tasks, especially complex, multi-turn, long-horizon problems with different forms of feedback and interactions. By connecting RL research with Snorkel’s ability to build high-quality, domain-specific tasks, environments, and data—and using training and evaluation results to improve both—you will help push model capabilities forward and shape a distinctive research direction for Snorkel.

You will lead research and development on RL training for large language models. This includes designing algorithms and training recipes, implementing them in our scalable framework, and evaluating their impact across diverse tasks and environments. You will diagnose training behavior and model failures, then work with the data team to identify gaps in tasks, environments, or training signals and assess whether changes improve results. A key focus is extending RL to modern settings such as extremely complex, multi-turn, long-horizon tasks with various forms of feedback.

MAIN RESPONSIBILITIES

Research and implement cutting-edge reinforcement learning algorithms and training recipes for large language models, adapting and extending methods such as GRPO for complex, multi-turn, and long-horizon tasks; evaluate their effects on learning, generalization, and performance across diverse environments.

Design and build data pipelines that generate high-quality training signals for RL workflows, including AI-assisted data annotation and curation data pipelines to improve model generalization to unseen benchmarks .

Prototype and iterate on end-to-end RL training recipes, using training and evaluation results to identify what improves performance and where tasks, environments, or training signals need to change.

Work with research scientists, ML engineers, data teams, and delivery teams to diagnose training results, turn findings into actionable improvements to data and environments, and validate those improvements in subsequent training runs.

Stay current with advances in large-scale distributed LLM training and scalable RL, and apply relevant methods to our training systems and challenging environments, including tool-use and other complex tasks.

Contribute to Snorkel's research publications and internal knowledge base in RL and model training.

PREFERRED QUALIFICATIONS

Deep expertise in reinforcement learning for language models, including policy optimization, credit assignment, and learning from sparse or delayed rewards; experience designing or adapting methods for multi-turn and long-horizon tasks.

Experience training or fine-tuning 30B+ large language models at scale, including familiarity with distributed training infrastructure.

Strong proficiency in Python and ML frameworks, especially PyTorch and HuggingFace and hands-on experience with RL frameworks such as Verl.

Strong software engineering skills, with a track record of building research systems and training pipelines that others can run, extend, and maintain.

Familiarity with ML infrastructure and cloud platforms and tools (AWS, GCP, Kubernetes, Slurm, etc.); experience with large-scale RL training pipelines a strong plus.

Ability to analyze training behavior and evaluation results, identify likely causes of failures or regressions, and turn findings into concrete improvements to training methods, tasks, environments, or data.

Ph.D. in machine learning, reinforcement learning, or a related field strongly preferred; exceptional industry experience considered.

Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.

Salary range(s) for this role

$200,000 — $375,000 USD

Be Your Best at Snorkel

Requirements

  • ·Experience training or fine-tuning 30B+ large language models at scale, including familiarity with distributed training infrastructure.
  • ·Strong proficiency in Python and ML frameworks, especially PyTorch and HuggingFace and hands-on experience with RL frameworks such as Verl.
  • ·Strong software engineering skills, with a track record of building research systems and training pipelines that others can run, extend, and maintain.
  • ·Familiarity with ML infrastructure and cloud platforms and tools (AWS, GCP, Kubernetes, Slurm, etc.); experience with large-scale RL training pipelines a strong plus.
  • ·Ability to analyze training behavior and evaluation results, identify likely causes of failures or regressions, and turn findings into concrete improvements to training methods, tasks, environments, or data.

Benefits

No benefits package published with this listing. Ask about it at first interview.

How to apply

  1. 1Check the flexibility label above, hybrid, matches where you plan to live and work.
  2. 2Tailor your CV to the role at Snorkel AI, mentioning your remote working experience and working hours (US East).
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 7d ago. Last checked 17 Nov. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Similar roles

Other open data roles with comparable remote rules.

Browse all open roles

$200,000 to $375,000 · You'll be taken to the employer's careers page.