Adjudicator (Disagreement Resolution + Guideline Governance)

Convert disagreement into defensible ground truth while continuously tightening the guideline system.

Responsibilities

Resolve label disagreements from multi-rater overlap and QA escalations.; Use side-by-side comparisons, guideline references, and evidence frames/clips to decide final truth.; Classify disagreement causes (definition ambiguity, visibility limits, procedural variance, annotator error).; Maintain adjudication logs and update guidelines/decision trees with approved changes.; Escalate to clinical reviewer when needed; prepare concise packets for decision.; Ensure adjudicated outputs feed back into training/calibration and pre-label improvement.

Requirements

5–10+ years in annotation operations with deep experience in complex labeling tasks.; Strong judgment and consistency; able to apply guidelines rigorously.; Excellent written communication; can document rationale cleanly.

Nice to have

Surgical/clinical familiarity preferred; clinician-in-the-loop experience is a plus.