Staff AI Engineer - New York
Core
Design, build, test, deploy, and support scalable AI software components including foundation model training, LLM inference, similarity search, and guardrails to reshape how associates work and customers engage with Capital One.
Role type
Staff AI Engineer (LLM & Systems)
Builds
Production AI systems, foundation models, and proprietary solutions serving millions of customers
Domain
Financial Services / Large Language Models / AI Infrastructure
Deliverable
production ML models
Required skills
Python, Go, Scala, Java, LLM inference, similarity search, VectorDBs, model training, hardware optimization, system architecture
Preferred skills
Cloud platform deployment (AWS/GCP/Azure), cross-functional leadership, mentoring engineering teams, LLM optimization techniques, advanced AI research application
Technologies
AWS, Azure, PyTorch, Hugging Face, NeMo Guardrails, VectorDBs, C#, C++, Golang
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; design and support AI software components; invent state-of-the-art LLM optimization techniques; contribute to technical vision and roadmap for foundational AI systems
Seniority
Staff, hands-on IC with strategic influence
