Automation and Triage Engineer, Siri
Core
Build automated testing frameworks and pipelines to evaluate Siri's AI performance, intent understanding, and on-device context across Apple platforms.
Role type
Senior IC automation and quality engineering (AI/ML systems)
Builds
Automated test suites, evaluation scenarios, and triage systems for Siri's AI stack
Domain
Consumer AI assistants, multi-platform mobile and desktop operating systems
Deliverable
production ML models
Required skills
Python, Swift, test automation framework design, CI/CD pipeline construction, agentic coding systems, LLM evaluation methodologies, root cause analysis
Preferred skills
on-device AI, natural language understanding, conversational systems, scenario-based testing, agent trajectory analysis
Responsibilities
Design and maintain end-to-end automated test suites for Siri across iOS, macOS, iPadOS, CarPlay, and other Apple platforms; Author and scale evaluation scenarios reflecting real-world user intent; Investigate and triage complex failures across Siri's AI stack; Distinguish product regressions from infrastructure noise; Partner with engineering and ML teams to define quality metrics and validate improvements
Seniority
Senior, hands-on IC