Research Scientist - RL Training
New York City, NY (Hybrid) · San Francisco, CA (Hybrid) +1
$200k–$375k a yearRemote
Job details
- New York City, NY (Hybrid) · San Francisco, CA (Hybrid) +1
- Remote
- $200k–$375k a year (posted by the company)
- Full-time
- 316 - Research
- Posted 5 months ago
Sponsorship history
Past filings by Snorkel AI in public government data. Not a promise of sponsorship.
- Filed 4 H-1B LCAs in FY2025
Full job description
About Snorkel
Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises to move from better data to better outcomes.
Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!
ABOUT THE ROLE
We are looking for a Research Scientist to advance reinforcement learning for large language models. You will develop, implement, and run training methods that help models solve frontier-level challenging tasks, especially complex, multi-turn, long-horizon problems with different forms of feedback and interactions. By connecting RL research with Snorkel’s ability to build high-quality, domain-specific tasks, environments, and data—and using training and evaluation results to improve both—you will help push model capabilities forward and shape a distinctive research direction for Snorkel.
You will lead research and development on RL training for large language models. This includes designing algorithms and training recipes, implementing them in our scalable framework, and evaluating their impact across diverse tasks and environments. You will diagnose training behavior and model failures, then work with the data team to identify gaps in tasks, environments, or training signals and assess whether changes improve results. A key focus is extending RL to modern settings such as extremely complex, multi-turn, long-horizon tasks with various forms of feedback.
MAIN RESPONSIBILITIES
- Research and implement cutting-edge reinforcement learning algorithms and training recipes for large language models, adapting and extending methods such as GRPO for complex, multi-turn, and long-horizon tasks; evaluate their effects on learning, generalization, and performance across diverse environments.
- Design and build data pipelines that generate high-quality training signals for RL workflows, including AI-assisted data annotation and curation data pipelines to improve model generalization to unseen benchmarks .
- Prototype and iterate on end-to-end RL training recipes, using training and evaluation results to identify what improves performance and where tasks, environments, or training signals need to change.
- Work with research scientists, ML engineers, data teams, and delivery teams to diagnose training results, turn findings into actionable improvements to data and environments, and validate those improvements in subsequent training runs.
