Machine Learning Research Scientist, Evaluations
Scale AI · Research
- Location
- San Francisco, CA; Seattle, WA; New York, NY
- Metro
- San Francisco Bay Area, Seattle, New York City
- Workplace
- Unspecified
- Level
- Unspecified
- Type
- Unspecified
- Pay
- $166K–$207K/yr (estimated from posting text)
- Posted
- 2 months ago
- Source
- Greenhouse
Read the full posting & apply ↗
What the posting covers
About the company
Scale works with the industry's leading AI labs to provide high quality data and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling) and…
You will
Analyze model behavior to identify, characterize, and diagnose failure modes in frontier LLMs and Agents. You’ll identify everything from capability gaps and reasoning errors to robustness and alignment issues, all focusing on RCA. Design and build benchmarks…
Ideally you’d have
Ph.D. or Master's degree in Computer Science, Machine Learning, AI, or a related field. Deep understanding of deep learning, reinforcement learning, and large-scale model fine-tuning. Experience with post-training techniques such as RLHF, preference modeling,…
Ideally you’d have
Please reference the job posting's subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the locations of San Francisco, New York, Seattle is: $165,600—$207,000 USD PLEASE NOTE:…
About Us
At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy,…
Excerpts only. The employer’s page has the complete posting.