English Audio Rater
Core
Evaluate recorded conversations between users and AI voice agents to assess the quality of AI-generated interactions.
Role type
Quality Assurance Rater (AI Voice)
Builds
Evaluation data for AI voice agent development
Domain
Artificial Intelligence / Voice Technology
Deliverable
production ML models
Required skills
Active listening, Prosody analysis, Content evaluation, Written justification, Consistent judgment, Canadian English fluency
Preferred skills
Experience with AI evaluation frameworks
Technologies
AI voice agents
Responsibilities
Listen to recorded user-AI voice agent conversations, Rate content for helpfulness and relevance, Rate prosody for naturalness and expressiveness, Write specific justifications for ratings, Maintain consistent evaluation criteria
Sourced via lever · Listed on CareerPlan, which tracks 901,000+ jobs from 20+ sources.