Agent Gateway高级研发工程师-Data
Core
Design and develop the Agent Gateway system, managing unified access, request routing, model adaptation, protocol conversion, streaming returns, and session management.
Role type
Senior IC backend engineer (AI infrastructure)
Builds
High-concurrency, high-availability Agent Gateway infrastructure and developer tooling (SDKs, APIs, config platforms)
Domain
AI infrastructure / Network systems
Deliverable
production ML models
Required skills
Go/C/C++, TCP/IP network programming, performance tuning, fault localization, system design, dynamic scheduling strategies, observability (tracing, metrics, logging), security & authorization
Preferred skills
API Gateway/Service Mesh experience, LLM application/Agent platform/MCP/RAG/model routing experience
Responsibilities
Design and develop core gateway modules (routing, fallback, circuit breaking, rate limiting), build security and compliance capabilities, establish observability and monitoring systems, optimize developer experience and platform engineering, drive technical evolution in Agent infrastructure
Seniority
Senior, hands-on IC