AI Rater Guidelines Writer (Linguist / Instructional Designer)

• Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across a range of subject-matter domains.
• Design clear, non-contradictory rating guidelines and rubrics that raters can apply consistently, including under edge cases.
• Evaluate draft guidelines for ambiguity, internal contradiction, and coverage gaps, and revise until raters can apply them without escalation.
• Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise, discipline-specific rater instructions.
• Collaborate with other subject matter experts and program leads to ensure consistency and accuracy across guideline sets.

• 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field, with direct experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.
• Demonstrated ability to work across multiple subject-matter domains (e.g., finance, retail, insurance, legal, sports) and translate domain-specific nuance into clear, unambiguous instructions.
• Strong track record of resolving ambiguity and contradiction in written specifications — able to point to concrete before/after examples.
• Demonstrable career progression.
• Ability to engage reliably for at least 35 hours/week during weekdays.
• Strong written communication skills and the ability to explain complex or nuanced guidance clearly and precisely.

Project and contracting process: Mercor. Applications continue on the provider's website.