CareerPlanSign in

Educator/ Assessor Writer

Johannesburg, Gauteng🌐 Remote💼 Full-time💰 $187,200–$187,200🗓 2026-09-27

Core

Evaluate and compare AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions; assign quality scores and compose detailed rationales.

Role type

Contractor AI evaluation specialist (RLHF/annotation)

Builds

Training data for next-generation AI systems

Domain

Artificial Intelligence / Machine Learning

Deliverable

production ML models

Required skills

Evaluating AI-generated text against rubrics, assigning analytical quality scores, composing written rationales, detecting factual errors and inconsistencies, critical analysis, attention to detail

Preferred skills

Instructional design, assessment design, peer review, thesis supervision, academic writing support, experience with RLHF or annotation

Technologies

Digital content review platforms

Sourced via adzuna · Listed on CareerPlan, which tracks 847,000+ jobs from 20+ sources.