Sr. Data Engineer - Services Special Projects
Core
Design, build, and operate massively scalable real-time data pipelines that transform multimodal data streams into an intelligent, searchable foundation for Apple's customer experiences.
Role type
Senior IC Data Engineer (Real-time Data Platform & ML Infrastructure)
Builds
Scalable ETL/ELT pipelines, data lakes, and real-time processing infrastructure serving billions of users
Domain
Big Data, Real-time Streaming, ML Infrastructure
Deliverable
production ML models
Required skills
Distributed data processing (Apache Spark), Streaming frameworks (Kafka, Flink), Data modeling (Dimensional), Big Data storage (Parquet, ORC, Iceberg), ML Inference optimization (ONNX Runtime, TensorRT, Triton, vLLM), Container orchestration (Kubernetes/EKS), Workflow orchestration (Airflow, Beam), Cloud platforms (AWS), Programming (Scala, Java, Python)
Preferred skills
Data versioning (DVC, Delta Lake), Vector databases (pgvector, Milvus, FAISS), Graph databases (TigerGraph)
Responsibilities
Build batch and streaming ETL/ELT pipelines for diverse data sources; Develop Kafka-based ingestion pipelines; Define data quality checks, SLAs, and observability standards; Integrate raw signals with metadata for downstream analytics and billing; Implement data lineage, metadata management, and security; Advance the team's data stack tooling and frameworks.
Seniority
Senior, hands-on IC