AI Engineer, RL & Evals
Core
Build reinforcement learning environments and evaluation frameworks for subjective creative domains like design.
Role type
Senior IC AI Engineer (RL & Evals)
Builds
Production RL environments, evaluation systems, agent harnesses, and data pipelines for creative AI output.
Domain
Generative AI, Reinforcement Learning, Creative Design
Deliverable
production ML models
Required skills
Reinforcement learning, LLM evaluation, Python, PyTorch, Backend engineering, Distributed systems, Task design, Grading rubrics
Responsibilities
Build and scale RL environments for creative domains; Design tasks and grading rubrics for subjective quality; Develop agent harnesses and context layers; Ship end-to-end backend systems and data pipelines; Collaborate with research teams to improve model output.
Sourced via workable · Listed on CareerPlan, which tracks 878,000+ jobs from 20+ sources.
