Data Analyst (Remote)

Job Title: Data AnalystLocation: Remote / Global About the RoleWe are looking for a data-driven professional to join our analytics and quality team. In this role, you will analyze the performance of AI agents across finance-sector tasks to uncover root causes of failure and drive improvements in design, evaluation, and benchmarking frameworks. Key ResponsibilitiesConduct statistical failure analysis to identify recurring patterns in AI agent performance across prompts, rubrics, templates, and file typesInvestigate root causes behind performance issues in task execution, framework design, or data complexityPerform multi-dimensional analysis across finance sub-domains, task categories, and input typesDevelop dashboards and reports highlighting performance trends, failure clusters, and improvement opportunitiesRecommend enhancements to task design, quality rubrics, and evaluation metrics based on data findings Required QualificationsStrong understanding of statistical analysis, hypothesis testing, and pattern recognitionProficiency in Python (pandas, scipy, matplotlib/seaborn) or R for data analyticsHands-on experience in exploratory data analysis (EDA) and turning data into actionable insightsFamiliarity with AI/ML evaluation techniques and quality assessment metricsProficiency in Excel, SQL, and visualization tools such as Tableau or Looker Preferred QualificationsPrior experience in AI/ML model evaluation, data labeling quality, or automation analysisKnowledge of finance-sector concepts or willingness to learn finance domain structuresExperience with multidimensional failure analysis or benchmarking studiesUnderstanding of large-scale evaluation frameworks or test dataset design Equal Opportunity StatementWe welcome applicants from all backgrounds. Reasonable accommodations are available for qualified individuals with disabilities.