CareerPlanSign in

SDE II, ML Infra Services

USA💼 Full-time💰 $143,400–$143,400🗓 2026-09-10 → 2026-10-02

Core

Design and implement machine learning infrastructure platforms for capacity management, workload scheduling, and fleet orchestration across ML accelerators.

Role type

Senior IC machine learning infrastructure engineer

Builds

ML accelerator access systems with low wait times, high utilization, and zero-config deployment

Domain

Cloud-scale machine learning infrastructure and custom silicon

Deliverable

production ML models | infrastructure

Required skills

System design and architecture, software development lifecycle, performance profiling and optimization, root cause analysis, CI/CD pipeline implementation, container management, cloud service utilization

Preferred skills

Machine learning tool project leadership, instruction set architecture knowledge (CPU/NPU/GPU), hardware-software integration, large-scale ML workload management

Technologies

AWS Lambda, Big Data, CI/CD, Cloud, Docker, EC2, Hardware Support, Java, JavaScript, Kubernetes, Machine Learning, Python, TypeScript, AI, DevOps

Responsibilities

Design and code solutions to improve software architecture efficiency, create metrics and implement automation, identify and resolve software defects, build high-impact solutions for customers, participate in design discussions and code reviews, collaborate across functions to guide business decisions

Seniority

Senior, hands-on IC

Sourced via devitjobs · Listed on CareerPlan, which tracks 938,000+ jobs from 20+ sources.