Software Engineer - X Data
Core
Building and operating a distributed data platform that powers realtime and batch pipelines for user-behavior insights and product decisions.
Role type
Senior IC data engineer (distributed systems)
Builds
Production-grade realtime and batch pipelines, shared datasets, fact tables, and internal data products
Domain
AI product engineering, distributed computing, hybrid storage
Required skills
Python, Rust, Scala, Go, Java, Spark, Kafka, Flink, SQL, NoSQL, RMDBs, large-scale system design, data correctness validation
Preferred skills
None stated
Technologies
BigQuery, Trino, Clickhouse, Flink, Kafka, Spark, Scalding
Responsibilities
Design and operate realtime/batch pipelines ingesting billions of events daily; Create shared datasets and internal data products; Prototype tooling for data workflows and self-serve access; Own data correctness via invariants and root-cause analysis; Select and adapt query engines/frameworks; Partner with product/business teams to identify data gaps
Seniority
Senior, hands-on IC
