Engineering Manager, Machine Learning Platform Technologies
Core
Lead the Crawl Infrastructure team to operate a petabyte-scale distributed web crawl platform that feeds intelligence for Siri, Apple Intelligence, Spotlight, and Safari.
Role type
Senior Engineering Manager, Distributed Systems
Builds
Petabyte-scale distributed crawl infrastructure and data pipelines
Domain
Internet infrastructure, Distributed systems, AI/ML data foundation
Deliverable
infrastructure
Required skills
Distributed systems architecture, Cloud infrastructure (AWS), Kubernetes, Infrastructure as Code, Data pipeline design, Streaming (Flink), Batch processing (Spark), Columnar storage (Iceberg), Team leadership, Technical roadmap planning
Preferred skills
Web crawl systems (URL frontier, politeness, rate limiting, scheduling), Rust, Scala, Go
Responsibilities
Lead high-performing distributed systems engineers, Design and operate large-scale data collection platforms, Partner with product and ML teams on knowledge requirements, Balance reliability, feature velocity, and scalability in technical roadmap
Seniority
Senior, hands-on IC with management responsibilities
