Snorkel AI
More roles at Snorkel AIResearch Scientist - RL Training
Part remote, part office, you need to live within commuting distance of a named location.
Hybrid · New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)
Employer listed it 6 days ago · Added 6 days ago
First listed 6 days ago and still open.
Salary
$200,000 to $375,000
Location
Hybrid · New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)
Timezone
US East
Contract
Full-time
Experience
Mid
Category
Data
Stated by the employer in the job description
What the advert says
Quoted word for word from the employer's advert. Where it says nothing, we say so.
- Working hours
- Not mentioned in the advert
- Where you can work from
- Location eligibility not confirmed
- Contract
- Not mentioned in the advert
- Experience asked for
- Not mentioned in the advert
- Pay
Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.
Remote flexibility
Hybrid
This role is only partly remote, the employer expects time in the office around New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote), Remote, San Francisco, so you need to live within commuting distance.
What the employer says
- Source listing states candidate location: "New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote), Remote, San Francisco"
- Listing mentions "Hybrid"
What Nomaders makes of it
- Not suitable if you plan to move between countries
The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.
Before you apply
Experience: employer states
Written as a nice-to-have
- “in machine learning, reinforcement learning, or a related field strongly preferred; exceptional industry experience considered.”
Questions worth asking: Nomaders interpretation
- This role involves office time, but the advert does not say how often. Ask how many days a week are expected on site.
- The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.
Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.
About the role
About Snorkel
Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises to move from better data to better outcomes. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!
ABOUT THE ROLE
We are looking for a Research Scientist to advance reinforcement learning for large language models. You will develop, implement, and run training methods that help models solve frontier-level challenging tasks, especially complex, multi-turn, long-horizon problems with different forms of feedback and interactions. By connecting RL research with Snorkel’s ability to build high-quality, domain-specific tasks, environments, and data—and using training and evaluation results to improve both—you will help push model capabilities forward and shape a distinctive research direction for Snorkel.
You will lead research and development on RL training for large language models. This includes designing algorithms and training recipes, implementing them in our scalable framework, and evaluating their impact across diverse tasks and environments. You will diagnose training behavior and model failures, then work with the data team to identify gaps in tasks, environments, or training signals and assess whether changes improve results. A key focus is extending RL to modern settings such as extremely complex, multi-turn, long-horizon tasks with various forms of feedback.
MAIN RESPONSIBILITIES
Research and implement cutting-edge reinforcement learning algorithms and training recipes for large language models, adapting and extending methods such as GRPO for complex, multi-turn, and long-horizon tasks; evaluate their effects on learning, generalization, and performance across diverse environments.
Design and build data pipelines that generate high-quality training signals for RL workflows, including AI-assisted data annotation and curation data pipelines to improve model generalization to unseen benchmarks .
Prototype and iterate on end-to-end RL training recipes, using training and evaluation results to identify what improves performance and where tasks, environments, or training signals need to change.
Work with research scientists, ML engineers, data teams, and delivery teams to diagnose training results, turn findings into actionable improvements to data and environments, and validate those improvements in subsequent training runs.
Stay current with advances in large-scale distributed LLM training and scalable RL, and apply relevant methods to our training systems and challenging environments, including tool-use and other complex tasks.
Contribute to Snorkel's research publications and internal knowledge base in RL and model training.
PREFERRED QUALIFICATIONS
Deep expertise in reinforcement learning for language models, including policy optimization, credit assignment, and learning from sparse or delayed rewards; experience designing or adapting methods for multi-turn and long-horizon tasks.
Experience training or fine-tuning 30B+ large language models at scale, including familiarity with distributed training infrastructure.
Strong proficiency in Python and ML frameworks, especially PyTorch and HuggingFace and hands-on experience with RL frameworks such as Verl.
Strong software engineering skills, with a track record of building research systems and training pipelines that others can run, extend, and maintain.
Familiarity with ML infrastructure and cloud platforms and tools (AWS, GCP, Kubernetes, Slurm, etc.); experience with large-scale RL training pipelines a strong plus.
Ability to analyze training behavior and evaluation results, identify likely causes of failures or regressions, and turn findings into concrete improvements to training methods, tasks, environments, or data.
Ph.D. in machine learning, reinforcement learning, or a related field strongly preferred; exceptional industry experience considered.
Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.
Salary range(s) for this role
$200,000 — $375,000 USD
Be Your Best at Snorkel
Requirements
- ·Experience training or fine-tuning 30B+ large language models at scale, including familiarity with distributed training infrastructure.
- ·Strong proficiency in Python and ML frameworks, especially PyTorch and HuggingFace and hands-on experience with RL frameworks such as Verl.
- ·Strong software engineering skills, with a track record of building research systems and training pipelines that others can run, extend, and maintain.
- ·Familiarity with ML infrastructure and cloud platforms and tools (AWS, GCP, Kubernetes, Slurm, etc.); experience with large-scale RL training pipelines a strong plus.
- ·Ability to analyze training behavior and evaluation results, identify likely causes of failures or regressions, and turn findings into concrete improvements to training methods, tasks, environments, or data.
Benefits
No benefits package published with this listing. Ask about it at first interview.
How to apply
- 1Check the flexibility label above, hybrid, matches where you plan to live and work.
- 2Tailor your CV to the role at Snorkel AI, mentioning your remote working experience and working hours (US East).
- 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.
Found 7d ago. Last checked 17 Nov. Always confirm the details on the original posting, salary and location can change after publication.
Listing sourced from Company boards.
Similar roles
Other open data roles with comparable remote rules.
$200,000 to $375,000 · You'll be taken to the employer's careers page.