Company Introduction
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Role Overview
Position: STEM Expert – Contract, Remote
Commitment: 20 hours per week
Duration: 1 month
Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy, rigor, and instructional quality in biology, physics, and chemistry.
Responsibilities
    - Design and optimize STEM-based prompts with multiple constraints and scientific instructions.
 
    - Define and document evaluation standards for correct responses in STEM contexts, developing a comprehensive rubric.
 
    - Conduct model testing and grading by running prompts through models and assessing outputs against expectations.
 
    - Support benchmarking and quality assurance by collaborating in QA review processes to maintain scientific rigor and consistency.
 
    - Work independently and asynchronously to meet project deadlines and contribute to the continuous improvement of AI model performance.
 
Requirements / Qualifications
Must-Have Qualifications
    - BS or BA in Biology, Physics, or Chemistry
 
    - Familiarity with undergraduate-level biology, physics, and chemistry topics
 
    - Strong writing and critical thinking skills
 
    - Ability to work independently and meet deadlines
 
Preferred Qualifications
    - 2+ years of experience in teaching, research, or applied STEM discipline field
 
Engagement Details
    - Remote and asynchronous role
 
    - 20 hours per week commitment
 
    - 1-month duration
 
    - Structured project environment with clear goals and tools
 
Application Process (Takes 20-30 mins to complete)
    - Complete an AI-led interview, this should take around 15 minutes
 
    - Complete a 45-minute written assessment that will guide you through writing rubrics
 
    - If selected, you will be invited to work on the project
 
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
For any help or support, reach out to: [email protected]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.