Legal Research AI Evaluation Subject Matter Expert

The Work

You will evaluate AI-generated legal research and help produce high-quality examples for training and assessment. The work focuses on legal reasoning, source support, clear writing, and how well an answer follows the prompt.

• Review AI-generated legal research for accuracy, clarity, completeness, and prompt adherence.
• Find errors in issue spotting, jurisdiction handling, authority selection, citation accuracy, and rule application.
• Write clear explanations and model legal research memos that show careful reasoning.
• Create prompts and gold-standard outputs, including issue outlines, research plans, memo templates, and authority summaries.
• Rank model responses by correctness, defensibility, citation support, and clarity.
• Test outputs for misleading certainty, jurisdictional errors, bias, and reliability across legal scenarios.

What It Pays and Takes

This is remote, part-time contract work. The role is open to candidates in Germany, India, and the United States, and hiring spans multiple countries.

• Pay: $60 to $110 per hour.
• Time requirement: 20 or more hours per week.
• Work type: Part-time contractor role.
• Language: Professional English fluency at C1 level or higher.
• Education and experience: JD, LLB, or an equivalent legal research background with substantial primary-law research experience.
• Legal knowledge: Strong ability to interpret statutes, regulations, and case law, including holdings versus dicta and the relevance of procedural posture.
• Research quality: Strong citation hygiene, including quotation verification, pinpoint citations, and support for each proposition.
• Judgment: Ability to handle differences between jurisdictions and clearly state assumptions or limits.
• Writing: Clear and concise legal writing.
• Preferred: Experience with Westlaw, Lexis, or equivalent legal research tools.
• Strongly preferred: Experience in AI data training, editorial quality assurance, knowledge management, or legal publishing.
• Helpful: Experience with structured legal research from issue framing through authority retrieval and synthesis.
• Helpful: Comfort working across time zones in an hourly remote contractor setting.
• Hiring context: 850 total positions across countries.

About AI Training Work

AI training work is the human side of building artificial intelligence. Legal experts review and improve model outputs so AI systems learn to give more accurate, useful, and reliable answers in specialized fields.