Content Quality and Evaluation Specialist - Safety Model Operations
Core
Constructing and iterating Golden Sets for content safety, analyzing high-risk cases, and establishing Standard Operating Procedures (SOPs) to improve AI model performance and human review quality.
Role type
Senior IC content safety data specialist (model evaluation & QA)
Builds
Content safety data closed-loop, Golden Sets, and operational guidelines for AI safety models
Domain
Internet Trust & Safety / AI Model Operations
Deliverable
production ML models
Required skills
logical reasoning, data curation, SOP creation, cross-functional collaboration, data analysis, root cause analysis, attention to detail, cross-cultural communication
Preferred skills
machine learning logic, data labeling frameworks
Technologies
None explicitly stated
Responsibilities
Construct and iterate core Golden Sets for content safety; Conduct deep-dive analyses on high-risk safety cases; Drive content safety data closed-loop with cross-functional teams; Systematize universal methodologies for content quality management
Seniority
Senior, hands-on IC
