Senior Data Engineer (d/w/m)
Core
Building and operating the company's data backbone, including the Data Lake, BI platform on Databricks, and Airflow pipelines for metering and energy data.
Role type
Senior Data Engineer
Builds
Data Lake, BI platform on Databricks, Airflow pipelines, Postgres and time-series databases
Domain
Energy sector, Cloud infrastructure
Required skills
Data platform architecture, Databricks/Spark, Airflow, SQL, Postgres, Time-series databases (TimescaleDB), Python, AWS
Preferred skills
Managed Airflow (Astronomer), Hosted Databricks, Energy sector experience, German language
Technologies
Databricks, Spark, Airflow, Postgres, TimescaleDB, Python, AWS, Astronomer
Responsibilities
Design, build, and maintain Airflow pipelines for metering and energy data; Model and optimize Postgres and time-series databases; Ensure monitoring, alerting, and incident response for data reliability; Provide clean, structured data as a service to all squads; Drive technical evolution of the data platform by selecting and introducing new tools; Engage closely with the Data Science team to support their platform needs
Seniority
Senior, hands-on IC