Content Quality and Evaluation Specialist (Mandarin Speaking) - Safety Model Operations
Core
Constructing and iterating Golden Sets for content safety, conducting deep-dive analyses on high-risk cases, and systematizing QA mechanisms for AI model evaluation.
Role type
Senior IC content safety data specialist
Builds
Ground truth datasets, Standard Operating Procedures (SOPs), and quality assurance frameworks for AI safety models
Domain
Internet Trust & Safety / AI Model Operations
Deliverable
production ML models
Required skills
Content safety evaluation, Golden Set construction, Root cause analysis, SOP development, Cross-functional collaboration, Data metric tracking
Preferred skills
Machine learning logic, Data labeling frameworks
Technologies
N/A
Responsibilities
Curate long-tail and complex edge cases to establish accurate data standards for platform safety policies; Analyze high-risk safety cases to identify misapplication patterns and risk trends; Collaborate with global teams to drive content safety data closed-loop improvements; Establish daily Quality Assurance mechanisms to track and attribute core data metrics.
Seniority
Senior, hands-on IC
