General Clinician (MD/DO) - HLS Expert Pool

• Apply clinical judgment to grading-criteria development, dialogue evaluation, and structured annotation work that determines how AI systems are measured.
• Develop grading criteria by breaking down clinical questions into discrete, checkable criteria for consistent model response grading.
• Evaluate multi-turn clinical conversations for accuracy, safety, completeness, appropriate hedging, and correctness of escalation advice.
• Annotate clinical reasoning by recording the process of working through a case, including differential diagnoses considered and rejected.
• Review AI outputs to flag hallucinated findings, dangerous omissions, unsupported certainty, and technically correct but clinically unsafe advice.
• Author guidelines by defining edge cases and standards of care for a specialty to ensure consistent annotation across clinicians.
• Write difficult clinical cases to test the limits of current model reasoning.

• Active, unrestricted medical license in country of practice.
• Ability to write structured clinical rationale that a non-specialist reviewer can follow.

• Board certification in specialty.
• U.S. licensure and familiarity with U.S. standards of care and clinical guidelines.
• Background in primary care, internal medicine, emergency medicine, or hospitalist medicine.
• Prior experience in clinical annotation, AI evaluation, medical education, or question-writing.
• Experience in grading-criteria design, resident assessment, or clinical guideline development.
• Published research or sustained technical writing.

Project and contracting process: Mercor. Applications continue on the provider's website.