← Search

Staff+ Software Engineer, Safeguards

Anthropic · Safeguards (Trust & Safety)

Location
San Francisco, CA | New York City, NY
Metro
San Francisco Bay Area, New York City
Workplace
Unspecified
Level
Staff+
Type
Unspecified
Pay
$320K–$485K/yr (estimated from posting text)
Posted
12 months ago
Source
Greenhouse

Read the full posting & apply ↗

PythonTypeScript

What the posting covers

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and…

About the role

We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on…

About the role

Safeguards Interventions: Responsible for what happens when a safety system fires. You'll own the composable arsenal of intervention options that sit between our detection stack (classifiers and probes) and the user, across every Anthropic surface: 1P…

Responsibilities

Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review Build abuse detection mechanisms and infrastructure Surface…

You may be a good fit if you

Bachelor’s degree in Computer Science, Software Engineering or comparable experience Proficiency in Python and Typescript Ability to work across the stack Strong communication skills and ability to explain complex technical concepts to non-technical…

Strong candidates may also

8+ years of experience in a software engineering position Have experience with integrity, spam, fraud, or abuse detection and mitigation Have experience building trust and safety detection mechanisms and intervention for AI/ML systems Have experience with…

Logistics

Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience Minimum years of…

Logistics

Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working…

How we're different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work…

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to…