Staff + Sr. Software Engineer, Cloud Inference Launch Engineering
Core
Build and validate end-to-end inference infrastructure for Claude on AWS, GCP, and Azure, ensuring correctness and performance for model launches and feature rollouts.
Role type
Staff/Senior Software Engineer, Cloud Inference Launch Engineering
Builds
Inference servers, load balancers, and CI/CD pipelines for cloud platforms
Domain
Cloud Infrastructure, LLM Serving, Distributed Systems
Deliverable
production ML models
Required skills
High-performance distributed systems, automation/test infrastructure, major cloud platforms (AWS/GCP/Azure), Kubernetes, Infrastructure as Code, container orchestration
Preferred skills
LLM inference optimization, capacity-constrained scheduling, multi-region deployments, CSP partner integration, Python, Rust
Technologies
AWS, GCP, Azure, Kubernetes, Python, Rust
Responsibilities
Bring up inference for new model architectures on cloud platforms, integrate new inference features (structured sampling, prompt caching), identify and fix cross-platform inference gaps, design and own CI/CD infrastructure with shadow traffic and correctness checks, drive down merge-to-production cycle time, analyze observability data for performance bottlenecks and cost anomalies
Seniority
Staff/Senior, hands-on IC