← Back to live opportunities
MC

Mercor · Direct Gig Reference

Global Remote (Nigeria & Worldwide Eligible)

AI Model Evaluator & Rubric Specialist

Eligibility

Global Remote · Async

Work mode

Remote listed

Compensation

$20 – $45 / hr

Role description

Evaluate frontier LLM responses against structured multi-criteria rubrics, write detailed justification rationales, and identify factual or instruction-following failures across generalist and domain prompts.

Requirements & qualification

Strong analytical writing in English, disciplined instruction following, ability to separate verifiable facts from model hallucinations, and comfort grading complex pairwise comparisons.

Verify ongoing project availability, regional rules, and assessment steps on the official platform or employer page.