About the role
In this hourly, remote contractor role, you will work as a Nurse Specialist and/or Nurse Practitioner (NP) Subject Matter Expert (SME) to review AI-generated clinical responses and/or create expert healthcare content, evaluating reasoning quality and step-by-step clinical problem-solving while providing precise written feedback. You will assess solutions for accuracy, clarity, safety, and adherence to the prompt; identify errors in advanced assessment, diagnosis/differential thinking, ordering/interpretation of tests, prescribing/medication management (where within scope), care pathway selection, and escalation/red-flag recognition; fact-check clinical information; write high-quality explanations and model solutions that demonstrate correct reasoning; and rate and compare multiple responses based on correctness and reasoning quality.
Nurse Practitioners and Specialist Nurses across a range of fields, including but not limited to Family NP (FNP), Adult-Gerontology NP (AGNP), Acute Care NP (ACNP), Pediatric NP (PNP), Psychiatric-Mental Health NP (PMHNP), Women’s Health NP (WHNP), Neonatal NP (NNP), Nurse Midwife (CNM), Oncology NP, Cardiology NP, Emergency/Trauma NP, ICU/Critical Care NP, Perioperative/OR, Wound Care, Diabetes Education, and Community/Public Health advanced practice are welcomed.
This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your healthcare expertise directly helps improve the world’s premier AI models by making their clinical and public-health reasoning more accurate, reliable, and clearly explained.
Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.
What you'll do
- Develop AI Training Content: Create detailed prompts and gold-standard answers aligned to your specialty (assessment, diagnosis, management, patient education, documentation).
- Optimize AI Performance: Evaluate and rank AI responses to improve correctness, safety, clarity, and contextual relevance.
- Ensure Model Integrity: Test AI outputs for inaccuracies, unsafe recommendations, and bias; validate reliability across patient populations and scenarios.
What we're looking for
- NP / APRN (or equivalent advanced practice nursing qualification) with active licensure/registration (or eligibility) in at least one jurisdiction.
- 5+ years of nursing experience overall, including 2+ years in an advanced practice/specialist role (preferred).
- Strong advanced clinical reasoning: differential diagnosis, triage, red-flag recognition, and escalation aligned with your scope and setting.
- Experience managing common and complex conditions appropriate to your specialty, including follow-up planning, referrals, and patient education.
- Strong medication safety judgment, including contraindications, interactions (high level), renal/hepatic considerations (as relevant), and monitoring plans—within scope.
- Exceptional attention to detail when fact-checking and identifying unsafe assumptions, missing contraindications, inappropriate tests/therapies, or misinterpretation of results; minimum C1 English proficiency.
- Comfortable evaluating answers for internal consistency (timeline, physiology, dosing logic checks, guideline alignment), appropriateness for setting (ED vs inpatient vs outpatient), and patient-safety implications.
- Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
- Prior experience with AI data training/annotation, utilization review, clinical documentation review, guideline work, or healthcare editorial QA is strongly preferred.