CareerPlanSign in

AI Engineer: AI Foundations & LLM Core

USA💼 Full-time💰 $197,300–$245,600🗓 2026-09-20 → 2026-09-29

Core

Designing, building, and optimizing scalable AI systems including LLM inference, agentic workflows, and vector databases for banking applications.

Role type

Senior IC AI Engineer (LLM & Agentic Systems)

Builds

Production AI services for foundation model training, inference, agents, and multi-agent workflows

Domain

Financial Services / Large Language Models / Distributed Systems

Deliverable

production ML models

Required skills

LLM inference optimization, agentic workflow design, distributed system architecture, model governance, GPU/TPU utilization, vector databases, similarity search, trade-off analysis (cost/latency/throughput/accuracy)

Preferred skills

Advanced foundation model optimization, novel research application in production, cross-platform architectural influence

Technologies

PyTorch, CUDA, AWS, Azure, Golang, Java, Python, C++, C#, Hugging Face, vector databases

Responsibilities

Lead end-to-end architecture for complex AI systems; optimize training and inference software for hardware utilization; define AI model governance processes; mentor senior associates on scalable design; lead cross-functional technical reviews for security and compliance; design distributed systems for petabyte-scale model operations

Seniority

Senior, hands-on IC with mentorship responsibilities

Sourced via devitjobs · Listed on CareerPlan, which tracks 854,000+ jobs from 20+ sources.