Sr. Machine Learning Engineer, ML Systems Evaluation Engineering
Core
Build large-scale evaluation systems and datasets for Siri and Apple Intelligence using LLMs to assess model changes and conversation naturalness.
Role type
Senior Machine Learning Engineer (ML Systems Evaluation)
Builds
Offline evaluation insights, evaluation datasets, and adversarial scenarios for conversational AI models
Domain
Consumer AI / Conversational AI / Large Language Models
Deliverable
production ML models
Required skills
Large Language Models (LLM), LLM-as-a-Judge, Generative AI, dataset curation, Python, statistical evaluation, natural language understanding
Preferred skills
Conversational AI domain knowledge, evaluation coverage definition, cross-functional ML product delivery, systems engineering
Technologies
Python, Large Language Models, Generative AI
Sourced via apple · Listed on CareerPlan, which tracks 851,000+ jobs from 20+ sources.