AIML - Sr Data Scientist, Evaluation
Core
Develop evaluation methods and metrics to improve the quality of user-facing products like Siri and Apple Intelligence, guiding product development through rigorous data analysis and experimentation.
Role type
Senior IC data scientist (evaluation & experimentation)
Builds
Evaluation frameworks, analysis pipelines, and experimental designs for search quality and feature development
Domain
Consumer technology, search, and large language models (LLMs)
Deliverable
production ML models
Required skills
Statistical data analysis, experimental design, causal inference, prompt engineering, LLM-based evaluation, SQL/Spark, Python/R/Scala, data quality control, requirements specification
Preferred skills
Human annotation data analysis, cross-functional collaboration, project management, rapid skill acquisition
Technologies
SQL, Spark, Python, R, Scala, LLMs