AI Engineer (LLM Customization & Finetuning)
Core
Design, develop, test, deploy, and support large-scale production AI systems, including foundation model training, LLM inference, agentic workflows, and similarity search to improve banking products.
Role type
Senior IC AI Engineer (LLM & Agentic Systems)
Builds
Scalable AI services, agentic workflows, and optimized inference pipelines for Capital One's banking platform.
Domain
Financial Services / Large Language Models / Distributed Systems
Deliverable
production ML models
Required skills
LLM inference, agentic AI systems, vector databases, model optimization, distributed systems design, Python, CUDA, cloud platform expertise
Preferred skills
Leading AI system development, designing distributed systems for petabyte-scale training, defining AI governance processes, mentoring senior engineers
Technologies
PyTorch, AWS Ultraclusters, Hugging Face, VectorDBs, C++, C#, Java, Golang
Responsibilities
Design and own end-to-end architecture for complex AI systems; optimize training and inference for hardware utilization and latency; collaborate with infrastructure to improve GPU/TPU utilization; lead cross-functional technical reviews for security and compliance; mentor Principal and Senior Associates on scalable design.
Seniority
Senior, hands-on IC with mentorship responsibilities
