Data Platform Engineer
Core
Design and maintain scalable real-time data pipelines serving a unified analytical warehouse and feature-serving layer for a multi-tenant Web3/iGaming platform.
Role type
Senior Data Platform Engineer
Builds
End-to-end real-time data pipelines, ClickHouse warehouse, and feature-serving layer for AI agents
Domain
Web3, iGaming, Data Infrastructure
Deliverable
production ML models
Required skills
Apache Kafka, PySpark, SQL, ClickHouse, AWS Glue, CI/CD, Infrastructure-as-Code, Data Contracts, Multi-tenant Schema Design
Preferred skills
Feature Stores, Blockchain transaction flows, Regulated industry experience, Legacy query engine migration
Technologies
AWS Glue, PySpark, ClickHouse, Apache Kafka, Amazon MSK, Terraform, Kubernetes, ECS Fargate, Great Expectations
Responsibilities
Design scalable data pipelines using AWS Glue and PySpark; Engineer and optimize ClickHouse warehouse; Implement data contracts for multi-tenant onboarding; Build feature-serving layer for AI agents; Integrate with third-party databases and APIs; Establish monitoring and alerting procedures; Own CI/CD and infrastructure-as-code
Seniority
Senior, hands-on IC
