AI Evaluation & Annotation

Generalist - English & Hebrew

Remote AI evaluation role reviewing AI evaluation, annotation, and model review tasks for AuraOne AI Labs.

AI Evaluation & AnnotationRemote | Flexible contract review work$41 hourlyReviewed via shared intakeCategory aligned
Why this role matters

Remote AI evaluation role reviewing AI evaluation, annotation, and model review tasks for AuraOne AI Labs. High-quality AI systems need consistent human judgment, clear rubrics, and reviewers who can turn edge cases into better training signal.

Review model outputs, label edge cases, and improve training quality across high-volume AI workflows.

Fit snapshot

Who tends to win this track

We review domain depth, writing quality, and remote execution readiness before routing applicants into the final review queue.

  • Strong alignment with AI Evaluation & Annotation
  • Remote | Flexible contract review work delivery with structured feedback loops
  • Evidence of repeatable, high-judgment work
Compensation
$41 hourly

Comp band stays visible through routing and review.

Work model
Remote | Flexible contract review work

Built for remote specialist delivery from the start.

Role track
Model evaluation

Aligned to the AuraOne specialist network.

What you will do
  • Review, rate, label, or compare AI outputs using structured instructions and rubrics.
  • Flag hallucinations, unclear examples, policy issues, and cases that need specialist escalation.
  • Write short rationales that make each review decision easy to audit and reuse.
  • Help convert recurring mistakes into better evaluation examples and quality checks.
What you should bring
  • Strong reading comprehension, written communication, and attention to detail.
  • Comfort making consistent judgments from rubrics rather than personal preference.
  • Experience with AI evaluation, annotation, QA, language work, or domain review is helpful.
  • Dependable remote availability and willingness to work through structured task queues.
Review + routing

How this role moves from application to placement.

AuraOne uses a shared intake to confirm track fit, review readiness, and the best queue for your specialist profile.

Remote-first specialist routing
  1. Select role
  2. Shared intake
  3. Routing review
  4. Match + offer

One specialist application captures background, availability, and evidence.

Category context

This role belongs to the AI Evaluation & Annotation track, so reviewers prioritize domain fluency, structured judgment, and the ability to operate asynchronously.

Model evaluationmultilingual tasks
Routing signals — detail

Routing signals — detailed checklist

Reviewers weigh track alignment, written-judgment quality, and availability in concert. The list below expands on the compact aside at the top of the page.

  • Strong alignment with AI Evaluation & Annotation
  • Remote | Flexible contract review work delivery with structured feedback loops
  • Evidence of repeatable, high-judgment work
  • Remote execution with documented review habits
  • Availability that matches program-defined pacing
  • Writing quality that holds up under peer review
Curated next steps

Stay in the AI Evaluation & Annotation track

If this role is close but not perfect, keep momentum by scanning adjacent openings in the same specialist lane.

View this track
AI Evaluation & AnnotationRemote

Adversarial Prompt Expert

Remote AI evaluation role reviewing AI evaluation, annotation, and model review tasks for AuraOne AI Labs.

Fellowship · Feb 11—Dec 30 · Remote | Part-time AI Labs fellowship · Model evaluation

AI Evaluation & AnnotationRemote

Arabic Copyediting Specialist

Remote AI evaluation role reviewing AI evaluation, annotation, and model review tasks for AuraOne AI Labs.

$35 hourly · Remote | Flexible contract review work · Model evaluation

AI Evaluation & AnnotationRemote

Bahasa Indonesian Audio Evaluation Specialist

Remote AI evaluation role reviewing audio and voice tasks for AuraOne AI Labs.

$50 hourly · Remote | Flexible contract review work · Model evaluation