AI Model Policy Trainer, Mental Health

As an AI Model Policy Trainer focused on mental health, you will help evaluate how conversational AI systems respond to people discussing emotional distress, mental-health conditions, unusual beliefs, possible crises, and other sensitive experiences. You will review conversations and model behavior against a detailed mental-health safety policy.

Responsibilities

Review user conversations and AI responses involving mental health, emotional distress, crisis, unusual beliefs, paranoia, hallucinations, mania, and related experiences; Apply detailed policy taxonomies and evaluation criteria to classify user requests and model behavior; Evaluate individual messages and changes in risk or certainty across longer conversations; Distinguish between validating a person's emotions and validating an unsupported or potentially harmful explanation; Assess whether AI responses remain neutral and reality-based or improperly reinforce, escalate, or operationalize harmful beliefs; Evaluate actions taken by AI systems through tools, including searches, messages, scheduling, purchases, file creation, and publication; Write clear rationales that connect each evaluation decision to evidence from the conversation and policy; Participate in calibration exercises and work with other trainers to improve consistency; Identify ambiguous examples, gaps, and edge cases that may require policy clarification; Review the work of other trainers and provide thoughtful, evidence-based feedback; Incorporate coaching and adapt as policies, rubrics, and model capabilities evolve; Collaborate with researchers, policy specialists, operations teams, and other subject-matter experts; Work regularly with sensitive and potentially distressing content

Requirements

Direct experience supporting individuals or families through mental-health or behavioral-health challenges; Mental health or behavioral health; Social work or community-based services; Nursing or patient care; Professional caregiving; Certified peer support; Family advocacy or care navigation; Crisis support or related human services; Ability to interpret sensitive conversations with empathy, precision, and cultural awareness; Ability to follow detailed policies and distinguish between closely related categories; Strong written communication and ability to explain decisions using specific evidence; Sound judgment when information is incomplete, ambiguous, or context-dependent; Openness to feedback, calibration, and evolving policy guidance; Strong boundaries and ability to engage with sensitive material professionally and sustainably; Comfort working independently in a detail-oriented, feedback-heavy environment; Located in Seattle area or willing to relocate to Seattle

Nice to have

Clinical licensure; AI or technology experience; Familiarity with conversational AI tools and interest in how people use them for emotional support; Balanced understanding of potential benefits and risks of AI-mediated mental-health conversations; Experience with structured review, case documentation, assessment, triage, quality assurance, or rubric-based evaluation; Experience working with people experiencing crisis, psychosis, paranoia, mania, hallucinations, suicidal ideation, or severe emotional distress; Experience as certified peer specialist, family advocate, patient advocate, case manager, crisis counselor, social worker, nurse, caregiver, or behavioral-health professional; Familiarity with ChatGPT, Claude, Gemini, or other conversational AI systems; Experience evaluating AI outputs, annotating data, applying content policies, or conducting quality reviews; Understanding of how culture, language, disability, socioeconomic circumstances, and access to care can affect mental-health conversations; Experience participating in case consultation, supervision, audit, or calibration processes