Manufacturing Specialist - Fully Remote

AI Model Evaluation Specialist

Position: AI Model Evaluation Specialist
Type: Contract
Compensation: $25–$35/hour
Commitment: 20 hours/week

Responsibilities

• Write realistic prompts reflecting professional and consumer domain‑specific guidance.
• Evaluate AI‑generated responses for factual accuracy and practical usefulness.
• Identify fabricated claims and misleading reasoning in model outputs.
• Score and rank model responses using structured rubrics.
• Provide written justifications with specific evidence for evaluations.

Qualifications

• Professional experience applying domain expertise in a practitioner or advisory capacity.
• Familiarity with industry‑specific standards, regulations, or clinical guidelines.
• Strong written communication and critical reasoning skills.