Retail Expert - Model Evaluator

AI Model Evaluation Contractor

Type: Contract

Compensation: $23–$30/hour

Commitment: 20 hours/week

Role Responsibilities

• Write realistic prompts reflecting professional and consumer domain-specific guidance.
• Evaluate AI-generated responses for factual accuracy, regulatory correctness, and practical usefulness.
• Identify fabricated claims, incorrect references, or misleading reasoning in model outputs.
• Score and rank multiple model responses using structured rubrics across dimensions.
• Provide written justifications with specific evidence for each evaluation.

Qualifications

• Master’s degree in a relevant professional field.
• Professional experience applying domain expertise in a practitioner or advisory capacity.
• Familiarity with industry-specific standards, regulations, or clinical guidelines.
• Strong written communication and critical reasoning skills.