CareerPlanSign in

Senior Machine Learning Engineer

Arlington, Virginia, United States; Pittsburgh, Pennsylvania, United States; Remote🌐 Remote💼 Full-time🗓 2026-08-25 → 2026-09-30

Core

Build the infrastructure powering the development, evaluation, deployment, and continuous improvement of language models and AI systems.

Role type

Senior IC machine learning engineer (LLMOps & infrastructure)

Builds

LLMOps platforms, training/fine-tuning infrastructure, model serving, and observability systems

Domain

Enterprise readiness, government agencies, industrial suppliers

Deliverable

infrastructure

Required skills

Python, Kubernetes, cloud platforms (AWS/GCP/Azure), distributed systems, GPU infrastructure, LLM lifecycle, experiment management, data pipelines, model versioning, automated evaluation, observability

Preferred skills

Security clearance, startup environment, secure code execution, multi-agent architectures, reinforcement learning, AI security

Technologies

Python, Kubernetes, AWS, GCP, Azure, LoRA, QLoRA, distributed training

Responsibilities

Design and build LLMOps infrastructure; Build scalable training and fine-tuning infrastructure; Develop data pipelines for training and evaluation; Build systems for dataset versioning and lineage; Develop experiment management infrastructure; Build automated evaluation pipelines; Design model registries and artifact management; Build model-serving and inference infrastructure; Develop abstractions for multi-model usage; Build observability for training and inference; Optimize workloads for GPU utilization and cost; Build automated deployment workflows; Investigate infrastructure failures.

Seniority

Senior, hands-on IC

Sourced via greenhouse · Listed on CareerPlan, which tracks 885,000+ jobs from 20+ sources.