MC
Mercor · Direct Gig Reference
Global Remote (Nigeria & Worldwide Eligible)AI Model Evaluator & Rubric Specialist
Eligibility
Global Remote · Async
Work mode
Remote listed
Compensation
$20 – $45 / hr
Role description
Evaluate frontier LLM responses against structured multi-criteria rubrics, write detailed justification rationales, and identify factual or instruction-following failures across generalist and domain prompts.
Requirements & qualification
Strong analytical writing in English, disciplined instruction following, ability to separate verifiable facts from model hallucinations, and comfort grading complex pairwise comparisons.
Verify ongoing project availability, regional rules, and assessment steps on the official platform or employer page.