Radiologists: Medical Image Review for AI Benchmarks

We're running a paid study on the accuracy and reliability of diagnostic imaging algorithms. High-quality reference evaluations are essential for establishing safe and effective medical benchmarks. Your clinical expertise will directly inform the baseline ground truth used to evaluate these emerging tools. You will review a series of de-identified medical images and associated clinical cases through a secure remote platform. For each case, you will provide an expert read and complete a structured scoring rubric. The workflow involves assessing specific diagnostic criteria and highlighting key anatomical or pathological findings. All tasks are completed asynchronously, allowing you to evaluate the cases at your own pace. We welcome general radiologists, neuroradiologists, musculoskeletal radiologists, and other imaging subspecialists.

Responsibilities

Review de-identified medical images across various clinical modalities; Provide expert clinical reads and diagnostic assessments for each case; Complete structured scoring rubrics based on findings; Establish reference evaluations to serve as ground truth for algorithmic benchmarks

Requirements

Licensed and practicing radiologist; Strong clinical diagnostic experience; Active practice as a radiologist or specialized imaging physician; Extensive experience interpreting complex clinical cases; Comfortable applying standardized rubrics to complex diagnostic cases; Comfortable providing structured, rubric-based diagnostic evaluations

Benefits

Paid study participation; Asynchronous tasks completed at your own pace