About the role
In this hourly, remote contractor role, you will review AI-generated legal analyses and/or generate expert legal content, evaluating reasoning quality and step-by-step issue-spotting while providing precise written feedback. You will assess answers for accuracy, clarity, and adherence to the prompt; identify errors in legal methodology or doctrine; fact-check citations and stated rules; write high-quality explanations and model solutions; and rate and compare multiple responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your legal expertise directly helps improve the world’s premier AI models by making their legal reasoning more accurate, reliable, and clearly explained.
Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.
What you'll do
- Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects.
- Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance.
- Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases.
What we're looking for
- Bachelor’s degree (or higher) in Law (JD/LLB), Legal Studies, Public Policy, or Political Science, with strong grounding in Constitutional Law, Contracts, Torts, Criminal Law, Civil Procedure, and Regulatory/Administrative Law.
- 5+ years of professional experience in Law, Legal Studies, Public Policy, or Political Science.
- Strong legal reasoning and issue-spotting skills, including statutory interpretation, case analysis, and translating facts into elements and defenses.
- Fluent in compliance concepts, rights & obligations analysis, and policy frameworks; able to identify missing facts and assumptions that change outcomes.
- Exceptional attention to detail when checking rule statements, citations, jurisdictional relevance, procedural posture, and logical consistency; Minimum C1 English proficiency.
- Able to write clear, structured feedback that explains errors and the correct reasoning path without unnecessary verbosity.
- Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
- Previous experience with AI data training/annotation, expert review, legal editing, or QA is strongly preferred.