AI Engineer 5 (MLX, Agentic AI, Gen AI platform Services)
Core
Design, develop, and optimize large-scale production AI systems, including foundation model training, LLM inference, agentic workflows, and multi-model orchestration for banking applications.
Role type
Senior IC AI Engineer (MLX, Agentic AI, Gen AI platform)
Builds
Scalable, high-performance AI infrastructure and proprietary solutions empowering Capital One teams and customers.
Domain
Financial Services / Generative AI / Large Language Models
Deliverable
production ML models
Required skills
Foundation model training, LLM inference, agentic workflows, multi-model orchestration, model optimization, cost-performance governance, system design, Python, Go, CUDA, Java, PyTorch, VectorDBs, similarity search, guardrails, model evaluation, experimentation, observability
Preferred skills
Leading development of AI systems with tradeoff decisions, deploying scalable AI on cloud platforms, designing complex AI systems, building agentic AI systems, applying state-of-the-art optimization techniques, architecting heterogeneous AI systems, enforcing ethical AI standards, balancing model performance and operational cost, right-sizing models and hardware
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, Python, Go, Scala, Java, C++, C#
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Design, develop, test, deploy, and support AI software components; Invent and introduce state-of-the-art foundation model optimization techniques; Contribute to the technical vision and long-term roadmap of foundational AI systems; Design and implement multi-model orchestration pipelines; Establish and lead cost-performance governance reviews; Lead team design councils or design review boards; Mentor Principal and Manager-level AI engineers
Seniority
Senior, hands-on IC with mentorship responsibilities