Senior Clinical QA Specialist, AI

Senior Clinical QA Specialist, AI role at BetterHelp to join the Clinical Quality and AI Team, ensuring AI features and outputs meet safety, clinical, and compliance standards while contributing to long-term AI strategies and leading the AI Clinical Quality Assurance program.

Responsibilities

Help develop, operationalize and refine QA frameworks, including testing protocols, evaluation rubrics, monitoring systems and review processes for AI tools; Conduct ongoing pre- and post-production evaluation and auditing of AI outputs for clinical safety, accuracy and bias, and alignment with therapeutic, ethical and regulatory standards; Review and assess AI-related escalations from BetterHelp therapists, clients, and/or customer-facing teams; identify patterns, severity, and appropriate escalation pathways; Analyze QA findings and trends to generate clear, actionable Clinical AI QA reporting, including recommendations for improving AI features, model behavior, prompts, guardrails and workflows; Communicate reporting with cross-functional partners; Help develop and maintain clinical AI risk and escalation pathways in partnership with relevant cross-functional teams (e.g., Legal, Compliance, Clinical Operations); Support clinical risk assessment for new and evolving AI capabilities, including identifying potential failure modes and defining appropriate safeguards; Stay current on emerging AI QA and evaluation methodologies, tools, research, and industry best practices; Contribute to research studies or evaluations related to AI efficacy, safety, quality and emerging evaluation approaches; Support Clinical Department initiatives, including office hours, newsletters, and other team programs as needed; Represent BetterHelp externally in public events, webinars, presentations and/or conferences as appropriate

Requirements

Graduate degree (Masters or Doctorate) in counseling, psychology, or social work; Clinical background in mental health (e.g., psychotherapy, telemedicine, digital mental health, or related care settings); Knowledge of emerging AI regulatory frameworks and best practices for AI in mental health (e.g., crisis response models and digital escalation workflows); Experience working in AI, technology, or data science applications in healthcare settings; Knowledge of quality assurance, auditing, and compliance processes, including privacy, security and confidentiality standards in mental healthcare; Strong communication skills with the ability to translate clinical expertise into clear operational and product guidance for AI systems; Strong analytical and problem-solving skills; comfort operating in fast-paced, data-driven environments; Experience collaborating with cross-functional teams; Growth mindset, curiosity, and a passion for advancing mental health care through safe and innovative technologies; Broad understanding of evidenced based therapeutic approaches and current clinical trends

Nice to have

Specialized degrees, certifications, or training in AI; Familiarity with LLM evaluation methods and/or direct experience in AI evaluation (e.g., redlining AI outputs for model improvement); Background in data analytics or research; Ability to rapidly learn new technologies and processes with minimal direction

Benefits

Remote work with regular in-person bonding experiences sponsored by the company; Competitive compensation; Performance bonus eligibility; Holistic perks program (including free therapy, employee wellness, and more); Excellent health, dental, and vision coverage; 401k benefits with employer matching contribution; Any piece of hardware or software that will make you happy and productive; Travel expenses covered for company office visits