Machine Learning Evaluation Engineer
Core
Define and drive evaluation strategy for computer vision and machine learning algorithms, ensuring high-quality, robust experiences across diverse real-world scenarios.
Role type
Machine Learning Evaluation Engineer
Builds
Scalable evaluation methodologies, automated workflows, failure analysis tools, and visualizations
Domain
Computer Vision / Machine Learning
Deliverable
production ML models
Required skills
Metrics design, failure analysis, data quality analysis, Python programming, statistical analysis, visualization, automated pipeline development
Preferred skills
Deep learning frameworks, synthetic data generation, model monitoring, generative AI workflows, technical leadership
Technologies
Python, deep learning frameworks, AI-assisted tools
Responsibilities
Design metrics and evaluation methodologies beyond aggregate accuracy; analyze large-scale datasets to identify data quality gaps; investigate model failures and develop taxonomies; build tools and visualizations for failure exploration; develop scalable automated workflows for evaluation and reporting.
Seniority
Mid-Senior, hands-on IC
