Backend Engineer – Data Acquisition
Core
Design and develop high-performance backend systems in Rust to collect billions of data points from the web, handling HTTP stacks, proxies, and browser tooling.
Role type
Senior IC backend engineer (data acquisition/crawling)
Builds
High-scale data acquisition infrastructure and proxy layers for a commercial strategy AI platform
Domain
Internet infrastructure / Web scraping / Hospitality technology
Deliverable
production ML models
Required skills
Rust, HTTP protocol implementation, proxy architecture, browser automation, system design, observability, test-driven development
Preferred skills
Experience with AI agent integration, security hardening, distributed systems
Technologies
Rust, HTTP, proxies, browser tooling
Responsibilities
Design and build backend systems handling ~200M daily requests; develop in-house proxy layers and request routing; investigate and solve crawler blocking issues; create interfaces for AI agents; ensure code quality and maintainability; collaborate with DevOps and Security teams