Data Platform SRE, AI & Data Platforms (AiDP)
Core
Develop and operate large-scale big data platforms to support critical analytics, reporting, and AI/ML applications.
Role type
Senior Site Reliability Engineer (Data Platform)
Builds
Big data platforms, data lakes, and distributed data processing systems
Domain
Enterprise technology, AI/ML infrastructure, Cloud computing
Deliverable
infrastructure
Required skills
Java, Scala, Python, Go, Apache Spark, Apache Iceberg, AWS, GCP, Unix/Linux, Incident management, Root cause analysis
Preferred skills
Kubernetes, Airflow, DBT, Data modeling, MLFlow, LLMs, Open Source contributions
Technologies
Apache Spark, Apache Iceberg, AWS, GCP, Kubernetes, Airflow, DBT, MLFlow
Responsibilities
Develop and operate large-scale big data platforms using open source solutions; Support critical applications including analytics, reporting, and AI/ML apps; Optimize platform performance and cost efficiency; Automate operational tasks for big data systems; Identify and resolve production errors and issues to ensure platform reliability
Seniority
Senior, hands-on IC