Spark引擎研发工程师 - 数据平台
Core
Designing and optimizing an EB-scale OLAP engine to support ETL, Ad-Hoc, and lakehouse analysis for major product lines.
Role type
Senior IC Spark engine development engineer
Builds
EB-scale OLAP engine for ETL, Ad-Hoc, and lakehouse analysis
Domain
Big data infrastructure / OLAP engines
Deliverable
production ML models
Required skills
Spark kernel optimization, OLAP engine internals, vectorized execution, SIMD programming, columnar storage, parallel programming, system-level fault diagnosis, performance tuning, architecture design
Preferred skills
Doris, Presto, Druid, Kylin, Hive, Impala, ClickHouse, StarRocks
Technologies
Spark, Doris, Presto, Druid, Kylin, Hive, Impala, ClickHouse, StarRocks
Responsibilities
Optimize Spark and Doris kernels; Design data engine architecture; Improve performance, cost-efficiency, and stability
Seniority
Senior, hands-on IC
