Director, Product Management AI Quality & Evaluation
Core
Building the enterprise AI evaluation platform, defining quality taxonomies, and driving adoption of shared evaluation standards across product teams to ensure safe AI deployment in financial workflows.
Role type
Director, Product Management (AI Quality & Evaluation)
Builds
Shared AI evaluation platform, golden datasets, and quality measurement standards for LLMs and ML systems.
Domain
Financial services / AI Quality & Evaluation
Deliverable
production ML models
Required skills
AI/ML product management, evaluation methodology design, platform adoption strategy, cross-functional leadership, LLM observability, change management, stakeholder influence, technical fluency in eval pipelines.
Preferred skills
Financial services domain knowledge, regulated AI deployment experience, model risk management.
Responsibilities
Define AI quality taxonomy and failure classification standards; own the roadmap and adoption strategy for the shared evaluation platform; manage human review operations for calibration and adjudication; establish minimum quality baselines for all AI capabilities; drive migration of product teams to shared tooling; close the loop from client-reported failures to regression tests.
Seniority
Director, hands-on IC with team leadership
