We are looking for Generalist Expert candidates for a project delivered through Mercor.
What you'll do
- Write prompts and reference answers on everyday questions that have a right answer, with the context a good response has to account for.
- Grade model output on general reasoning: whether the answer is correct, whether it follows the instruction actually given, whether it is complete without padding.
- Flag where a model is confidently wrong, contradicts itself earlier in the same answer, or answers a question that was not asked.
What you need
- Have careful reading and sound judgment, from a professional or academic background in any field.
- Have clear written communication, since most of the work involves explaining your reasoning.
- Be comfortable with ambiguous tasks, and willing to flag unclear instructions.
Expertise
clear written communicationambiguous tasksjudgmentwriting promptsgrading model outputflagging model errors
RequiredAlso useful
Also listed: attention to detail.
Who you work with
Project and contracting process: Mercor. Applications continue on the provider's website.