Data Engineer
Core
Build and scale data pipelines and platforms to process raw sensor data (LiDAR, imagery, GPS) into client-ready geospatial deliverables for city infrastructure management.
Role type
Senior Data Engineer (Infrastructure Intelligence)
Builds
Production data pipelines, data platforms, and automated quality monitoring for geospatial outputs
Domain
Geospatial data, Infrastructure Intelligence, Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, SQL, Cloud data infrastructure (AWS), Workflow orchestration (Airflow/Dagster/Prefect), Large dataset reliability, End-to-end system ownership
Preferred skills
Geospatial data (PostGIS, GDAL, GeoParquet, H3), Sensor data (LiDAR, GPS/IMU), Lakehouse formats (Iceberg, Delta, DuckDB, Spark), Containerization (Docker, Kubernetes), Infrastructure as Code (Terraform), ML pipeline support
Technologies
AWS, Airflow, Dagster, Prefect, PostGIS, GDAL, GeoParquet, H3, Iceberg, Delta, DuckDB, Spark, Docker, Kubernetes, Terraform
Responsibilities
Design and operate pipelines moving sensor data from ingest to geospatial outputs; Maintain data platform for product and AI teams; Build automated data quality checks and monitoring; Partner with GIS teams to automate workflows; Optimize processing cost and performance on AWS
Seniority
Senior, hands-on IC