Expert Talent Pool Feedback and Alignment

Remote • Senior • vor 1 Tagen
Content Creator redakteur
Auf einen Blick

Expert Talent Pool für KI-Modell-Bewertung und Kalibrierung. Erfahrene Reviewer mit 5+ Jahren Background in Bewertung, Fact-Checking oder Quality Assurance werden für hochspezialisierte Projekte gesucht.

💰 $50–120/h 📊 Senior 🕒 Contract 🌍 Remote 🗺️ Worldwide
  • 5+ Jahre Bewertungs- oder Fact-Checking-Erfahrung
  • Native oder nahezu native Englischkenntnisse (schriftlich)
  • Erfahrung mit Rubric-basiertem Grading
  • Leadership- oder Review-Erfahrung bei anderen Ratern
Fact-Checking

Angegeben: $50–120/h · Marktschätzung: ~$50–120/h.

✅ Geeignet für
  • Fact-Checker und Content-Reviewer mit 5+ Jahren Erfahrung
  • QA-Leads oder Quality Assurance Profis
  • Spezialists in Mathematik, Code, Recht, Medizin oder Finanzen
🚫 Weniger geeignet
  • Junior Reviewer ohne Führungserfahrung
  • Kandidaten ohne 5 Jahre professionelle Review-Erfahrung
  • Nicht-Native English Sprecher (schriftlich)
💡 Gut zu wissen
  • Talent Pool - Projekte sind variable Länge (1 Woche bis mehrere Monate)
  • Bezahlung nach Stunden gearbeitet, nicht Gehalt
  • Erfordert native oder nahezu native Englisch-Schreibkompetenz
  • Projekte können hochspezialisierte Fachbereiche erfordern

About the Role

Join a remote expert network as a senior rater and reviewer, evaluating complex AI model outputs and helping calibrate other graders. Your work supports the development of high-quality, trustworthy AI systems across specialized fields.

What You'll Do

  • Rank and rate expert-level model answers using detailed rubrics and write clear rationales.

  • Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.

  • Fact-check complex claims against primary sources and verify accuracy.

  • Assess answers against content policies, style guides, and edge cases.

  • Review other raters' work, calibrate standards, and develop or refine grading guidelines.

  • Assess search relevance and provide feedback in live sessions.

What We're Looking For

  • At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or a relevant professional domain.

  • Native or near-native written English proficiency.

  • Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.

  • Experience leading or reviewing other raters, such as as a QA lead, rubric owner, or reviewer of reviewers.

  • An advanced degree, professional license, or deep working expertise in the domain you grade.

  • Hands-on AI data annotation experience, search-quality rating, or experience writing and maintaining grader guidelines is a plus.

Compensation & Benefits

Compensation is $50 to $120 per hour, depending on the project, field, and expertise level. Payment is based on hours worked.

Location

Fully remote. Projects typically run from one week to several months.



Please mention the word **UPLIFTING** and tag RODUuMTMuMTUwLjIwNg== when applying to show you read the job post completely (#RODUuMTMuMTUwLjIwNg==). This is a beta feature to avoid spam applicants. Companies can search these words to find applicants that read this and see they're human.