ML Scientist | Remote | $60/hr

Be among the first 25 applicants.

This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$50.00/hr - $60.00/hr

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

• Position: AI Research Evaluator
• Type: Contractor
• Compensation: $50–$60/hour
• Location: Remote
• Commitment: 30 hours/week

Role Responsibilities

• Review and audit submitted data, including prompts, solutions, final answers, references, and metadata.
• Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency.
• Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, identifying flaws, gaps, or inconsistencies.
• Assess coding problems by validating test cases, solution correctness, and language consistency.
• Provide concise, well-reasoned written feedback to justify evaluation decisions.
• Work independently and asynchronously following provided tools and workflows.

Qualifications

Must-Have Qualifications

• PhD (or current PhD candidacy) or Master's in Mathematics, Computer Science, Applied Mathematics, or a related STEM field.
• Expertise in one or more domains, including Mathematics (algebra, geometry, number theory, combinatorics, probability, graph theory), Coding (data structures, algorithms, application frameworks, testing & quality assurance), General domains (summarization, open/closed Q&A, classification, reasoning tasks).
• Strong analytical skills with the ability to evaluate multi-step reasoning.
• Excellent written communication and attention to detail.
• Ability to work independently in a fully remote environment.

Preferred Skills

• Basic knowledge of Python and testing frameworks (e.g., Pytest, JUnit).

Compensation & Legal

• Contractor position via Mercor, paid hourly.
• Competitive rates based on expertise: $50–$60/hour.
• Weekly payments processed securely through Stripe Connect.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check:
• For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.