About the role
Bring senior data science expertise to AI evaluation projects focused on statistical analysis, data quality, experiment design, and reproducibility. Review model responses and worked examples for incorrect technical assumptions, missing failure cases, and reliability or security gaps. Assess whether the reasoning meets professional standards for the stated task. Write reference answers and scoring criteria grounded in statistical analysis, data quality, experiment design, and reproducibility. Explain consequential errors, evidence gaps, and the reasoning behind your corrections. This is remote, project-based contract work. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.
What we're looking for
- 7+ years of substantive experience in data science or applied statistics.
- Demonstrated senior-level judgment in statistical analysis, data quality, experiment design, and reproducibility, with substantial responsibility for reviewing or delivering this work.
- Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.