Product Validation Engineer II: AI Agent Quality Assurance (QA)
Core
Validate AI Agent products and customer workflows through structured test planning, execution, and quality evaluation.
Role type
Product Validation Engineer (AI Agent QA)
Builds
AI Agent products and customer workflows
Domain
Semiconductor design tools / AI Agents
Deliverable
production ML models
Required skills
Test planning and execution, AI/LLM concepts, Python scripting, defect analysis, quality rubric creation, regression testing
Preferred skills
AI evaluation frameworks, red-team testing, vector databases, EDA/VLSI design verification
Technologies
Python, RAG workflows, vector databases, embeddings
Responsibilities
Validate AI Agent products and customer workflows, Test agent behavior across prompts and tool usage, Evaluate agent outputs using quality rubrics and metrics, Create and expand testcase suites and evaluation datasets, Document defects and support root-cause triage, Collaborate with product and engineering teams to improve quality
Seniority
Mid-level, hands-on IC