Senior Product Manager, AI Safety Evaluation & Governance - TikTok Safety Product
Core
Define evaluation methodologies, build ground truth datasets, and design benchmarks for AI-powered content safety models to ensure high-precision risk governance at scale.
Role type
Senior Product Manager, AI Safety Evaluation & Governance
Builds
Evaluation frameworks, ground truth datasets, and LLM-based assessment pipelines for content safety
Domain
AI/ML product development, trust & safety policy, data-driven quality assurance
Deliverable
production ML models
Required skills
AI/ML evaluation, SQL, LLM prompt engineering, content safety policy, cross-functional leadership, statistical analysis
Preferred skills
Large-scale content moderation frameworks, adversarial content patterns, human-in-the-loop systems, recommendation systems, agentic AI workflows
Technologies
LLMs, SQL, agentic workflows
Responsibilities
Define evaluation methodology for AI safety models; Design diverse positive-example evaluation datasets; Architect severity-stratified evaluation benchmarks; Conduct hands-on data analysis and model evaluation; Develop and iterate prompts for LLM-based pipelines; Drive cross-functional alignment; Scale and systematize evaluation operations
Seniority
Senior, hands-on IC
