About the role
In this hourly, remote contractor role, you will work as an Attorney / Lawyer Subject Matter Expert (SME) to review AI-generated legal responses and/or create expert legal content, evaluating reasoning quality and step-by-step issue analysis while providing precise written feedback. You will assess solutions for accuracy, clarity, completeness, and adherence to the prompt; identify errors in legal reasoning, rule application, procedural steps, and risk/assumption handling; fact-check legal concepts and (when required) citations; write high-quality explanations and model answers that demonstrate correct legal analysis and clear communication; and rate and compare multiple responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your legal expertise directly helps improve the world’s premier AI models by making their legal reasoning more accurate, reliable, and clearly explained.
Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.
What you'll do
- Develop AI Training Content: Create detailed prompts and gold-standard legal outputs (issue analyses, drafting examples, checklists, policies, and memos).
- Optimize AI Performance: Evaluate and rank AI responses to improve correctness, clarity, defensibility, and risk awareness.
- Ensure Model Integrity: Test AI outputs for inaccuracies, misleading certainty, confidentiality risks, and bias; validate reliability across legal scenarios.
What we're looking for
- JD/LLB (or equivalent law degree) and active bar membership (or eligibility) in at least one jurisdiction.
- 5+ years of professional experience practicing law (law firm, in-house, government, or legal aid).
- Strong ability to perform issue spotting and structured legal analysis (rules → application → conclusion), including identifying assumptions and uncertainty.
- Demonstrated experience in one or more practice areas (e.g., commercial/contracts, employment, privacy, corporate, litigation, IP, real estate, compliance).
- Strong research skills: locating and synthesizing primary authority (statutes, regulations, cases) and accurately characterizing holdings.
- Excellent drafting/editing skills: contracts/clauses, memos, letters, policies, pleadings (as applicable), with attention to precision and tone.
- Exceptional attention to detail when fact-checking and identifying overconfident claims, missing exceptions, jurisdictional pitfalls, or procedural risks; minimum C1 English proficiency.
- Comfortable evaluating answers for internal consistency, client safety, and appropriateness to context (e.g., consumer vs business, HR vs litigation).
- Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
- Prior experience with AI data training/annotation, legal QA, editorial review, or knowledge-management work is strongly preferred.