Senior Data Engineer
Core
Lead Snapper's data approach architecturally, building scalable data warehouses and pipelines for the Mosaiq public transit platform.
Role type
Senior IC data engineer (technical lead)
Builds
Large-scale data warehouses (Redshift/Snowflake/ClickHouse) and resilient ETL/ELT pipelines
Domain
Public transit data / Cloud data engineering
Required skills
Large-scale data warehouse architecture, Data modeling, SQL, Python, PySpark, AWS data services, Infrastructure as code (Terraform), CI/CD, Data quality practices
Preferred skills
ML systems exposure, Mentoring experienced peers
Technologies
Redshift, Snowflake, ClickHouse, Python, PySpark, AWS (Step Functions, Glue, Lambda, Kinesis, Athena, EMR), Terraform, Git, dbt, Airflow, MWAA
Responsibilities
Lead technical evaluation and recommendation of warehouse platform, Execute data warehouse build/migration, Architect scalable data pipelines, Act as technical leader and coach for data engineering team, Own data pipeline testing and data quality practices, Partner with stakeholders on architecture decisions
Seniority
Senior, hands-on IC with mentorship responsibilities