Senior Data Engineer
Core
Design and own end-to-end data pipelines processing billions of web events for web attribution, ensuring strict freshness and accuracy for advertisers.
Role type
Senior IC data engineer (big data/pipeline architecture)
Builds
Distributed data pipelines for web event ingestion, processing, and serving
Domain
AdTech / Web Attribution / Big Data
Deliverable
production ML models
Required skills
Apache Spark, cloud analytical warehouses (BigQuery/Snowflake/Redshift/Databricks), workflow orchestration (Airflow), Scala, Python, data modeling, system design, data quality logic
Preferred skills
AdTech attribution systems, functional programming, SQL transformation frameworks (dbt/Dataform), Kafka/streaming, LLM/ML pipelines
Technologies
Apache Spark, BigQuery, Snowflake, Redshift, Databricks, Airflow, GCP, Scala, Python, Kafka
Responsibilities
Build and improve pipelines processing billions of web events; Own technical design of pipelines from spec to production; Drive technical planning and roadmap with team lead; Represent team in cross-functional technical discussions; Own production incidents end-to-end
Seniority
Senior, hands-on IC
