Lead Data Science Manager

Mercor WorkFromHome

Stellenbeschreibung:

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Base pay range

$14.00/hr - $14.00/hr

Position

Data Scientist

Employment type

Hourly contractor

Compensation

$14/hour

Location

Remote

Commitment

20–40 hours/week

Role Responsibilities

Develop data collection and preprocessing pipelines for structured and unstructured data from multiple agent simulations.
Build and iterate on machine learning models for performance prediction, behavior clustering, and outcome optimization.
Design and maintain dashboards and visualization tools for monitoring agent performance, benchmarks, and trends.
Conduct statistical analyses to evaluate the efficacy of AI systems under various environments and constraints.
Collaborate with engineers to design evaluation frameworks that measure reasoning quality, adaptability, and efficiency.
Prototype data‑driven tools and feedback loops to automatically improve model accuracy and agent behavior over time.

Qualifications

Must‑Have

Strong background in data science, machine learning, or applied statistics.
Proficient in Python, SQL, and familiar with libraries such as Pandas, NumPy, Scikit‑learn, and PyTorch/TensorFlow.
Understanding of probabilistic modeling, statistical inference, and experimentation frameworks (A/B testing, causal inference).
Experience with large‑scale data systems (Snowflake, BigQuery, or similar).
Ability to collect, clean, and transform complex datasets into structured formats ready for modeling and analysis.

Preferred

Interest in AI agents and how data can shape their reasoning, adaptability, and behavior.
Enjoy collaborating with cross‑functional teams to define meaningful KPIs and experiment setups.