AI测试开发工程师(Agent方向) - 抖音研发中台
Core
Build AI testing capabilities and evaluation systems for large model applications, specifically focusing on intelligent customer service agents and software engineering quality assurance.
Role type
Senior AI Testing Development Engineer (Agent & LLM Evaluation)
Builds
Intelligent UI automation, test data generation, scenario case generation, code bug white-box identification, and automated evaluation frameworks for AI agents.
Domain
Internet / Large Language Models / AI Quality Assurance
Deliverable
production ML models
Required skills
Python, Go, Java, LLM evaluation, Prompt Engineering, AI agent development, automated testing, code analysis, data analysis
Preferred skills
Experience with AI4SE, intelligent verify capabilities, model effect tracking, cross-functional collaboration on complex systems
Technologies
Python, Go, Java, AI Coding tools, LLM frameworks
Responsibilities
Construct business evaluation systems for intelligent customer service agents; track online model performance and perform root cause analysis; build AI testing capabilities including smart UI automation and test data generation; collaborate with R&D to integrate AI verification into the development lifecycle.
Seniority
Senior, hands-on IC