CareerPlanSign in

AI Automation Engineer, Real-World Test Lab

San Francisco, CA💼 Full-time💰 $158,400–$158,400🗓 2026-09-29 → 2026-10-02

Core

Design and own end-to-end automation for evaluating physical AI systems (reconstruction, localization, spatial understanding) to produce trusted evidence for product releases.

Role type

Senior IC AI Automation Engineer (evaluation infrastructure)

Builds

Always-on evaluation service, automated test workflows, comparable scorecards, and diagnostic pipelines for physical AI models.

Domain

Physical AI, robotics, computer vision, 3D reconstruction, spatial intelligence

Deliverable

production ML models

Required skills

Python, orchestration, CI/CD pipelines, cloud storage, API integration, reproducible environments, technical writing, system evaluation

Preferred skills

Agent-based/LLM-driven automation, computer vision benchmarking, dashboard instrumentation, data provisioning infrastructure

Technologies

Python, orchestration tools, CI pipelines, cloud storage, APIs

Responsibilities

Build end-to-end automation for Lab evaluations (setup, orchestration, capture, collection); Instrument scorecards for cross-version/device comparison; Develop agent workflows for customer use cases; Convert manual experiments to standing automated protocols; Produce actionable diagnostics with reproducible data; Collaborate on data state management for reproducibility

Seniority

Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 928,000+ jobs from 20+ sources.