Senior Data Engineer / Consultant – Databricks & Azure (m/w/d)
Core
Design and implement Lakehouse solutions on Databricks and Azure, building production-ready data pipelines and establishing data quality and governance frameworks.
Role type
Senior Data Engineer / Consultant (Databricks & Azure)
Builds
Lakehouse solutions, production data pipelines, and analytics platforms for enterprise clients
Domain
Data Engineering, Cloud Data Platforms, Databricks, Microsoft Azure
Required skills
Data Engineering, Databricks, Microsoft Azure, Python, PySpark, SQL, Lakehouse Architecture, Delta Lake, Data Modeling, Git, CI/CD, Automated Testing, Data Quality, Data Governance, Unity Catalog, Customer Consultation
Preferred skills
Data Vault 2.0, Power BI, Semantic Data Models, Self-Service Analytics, Terraform, Infrastructure as Code, MLflow, RAG, AI Application Integration, Databricks/Azure Certifications
Technologies
Databricks, Microsoft Azure, Python, PySpark, SQL, Delta Lake, Unity Catalog, Git, CI/CD, Terraform, MLflow, Power BI
Responsibilities
Conceive and implement Lakehouse solutions from data source connection to analytics/KI readiness; Develop and optimize production pipelines using Python, PySpark, and SQL; Make architectural decisions regarding data models, processing, and interfaces; Implement data quality checks, authorization concepts, and data management; Translate business requirements into actionable work packages and explain technical options; Support colleagues through reviews and knowledge sharing
Seniority
Senior, hands-on IC with client-facing responsibilities