Staff + Sr. Software Engineer
Core
Design, build, and operate CI/CD infrastructure and inference servers for new LLM model architectures across cloud platforms.
Role type
Staff Software Engineer (LLM Inference Infrastructure)
Builds
Inference servers, load balancers, and CI/CD pipelines for LLM serving
Domain
Cloud Infrastructure / Large Language Models
Deliverable
infrastructure
Required skills
High-performance distributed systems, automation/test infrastructure, AWS/GCP/Azure, Kubernetes, Infrastructure as Code, container orchestration
Preferred skills
LLM inference optimization, batching, caching strategies, capacity-constrained scheduling, multi-region deployments, request routing, Python, Rust
Responsibilities
Bring up inference for new model architectures, own platform-specific integrations, fix configuration drift and observability gaps, design CI/CD infrastructure, implement shadow traffic and performance checks, analyze observability data to drive remediation
Seniority
Staff, hands-on IC
