AI产品体验运营 - AI数据与安全
Core
AI product experience operations focusing on strategy, evaluation, and optimization of large language models (LLMs) and AI-native applications for Douyin.
Role type
AI Product Strategy & Operations Specialist (LLM Evaluation)
Builds
AI model evaluation benchmarks, standardized evaluation systems, and prompt optimization workflows.
Domain
AI / Large Language Models / Content Strategy
Deliverable
production ML models
Required skills
LLM evaluation, prompt optimization, benchmark dataset construction, model hallucination analysis, user experience analysis, strategic planning, cross-functional coordination, AI tool proficiency.
Preferred skills
NDCG/GSB metrics knowledge, AIGC industry expertise, Agent workflow design, experience with Douyin ecosystem.
Responsibilities
Conduct deep experience testing and comprehensive evaluation of mainstream AI products and LLM capabilities; identify and resolve online model issues (hallucinations, semantic bias, UX gaps); build and iterate AI model-specific evaluation benchmarks and standardized scoring systems; optimize Prompts and Agent workflows to improve model content quality and user adaptation.
Seniority
Mid-level, hands-on IC
