Backend Software Engineer - Data Management Suite
Core
Design and implement a unified data development platform, distributed scheduling system, and metadata synchronization for global data pipelines.
Role type
Senior Backend Software Engineer (Data Platform)
Builds
Unified data development platform, distributed scheduling system, global metadata sync
Domain
Big Data Infrastructure / Distributed Systems
Deliverable
production ML models
Required skills
Data structures and algorithms, Software design and architecture, Testing and launching software products, Data management systems, Big data development platforms, Data catalog platforms, Data transfer platforms
Preferred skills
Large-scale infrastructure, Distributed systems, Compute technologies, Storage, Hardware architecture, Cross-functional project management, Hadoop, Clickhouse, Flink
Technologies
Hadoop, Clickhouse, Flink
Responsibilities
Design and implement a unified data development platform including intelligence IDE and workflow management; Manage distributed states and sync metadata globally; Design and develop a high-performance distributed scheduling system; Integrate with other big data systems; Collaborate with partner teams globally.
