Senior Data Engineer
Core
Build and operate a medallion architecture data platform (Bronze, Silver, Gold layers) on Databricks for a global automotive client program, enabling Analytics Engineers to generate insights and BI without structural pipeline issues.
Role type
Senior Data Engineer (Platform & Pipeline Architecture)
Builds
Production data pipelines, data lake layers, and CI/CD orchestration for batch and near real-time sources
Domain
Automotive / Data Engineering
Deliverable
production ML models | product features
Required skills
Databricks, Python, SQL, PySpark, Azure Data Lake Storage Gen2, Unity Catalog, Azure DevOps, Databricks Workflows, Medallion Architecture
Preferred skills
Salesforce integration, Databricks certification, Automotive/manufacturing domain experience
Responsibilities
Design and implement end-to-end medallion architecture on Databricks; ingest data from multiple source systems handling schema evolution; enforce data governance and lineage using Unity Catalog; build and maintain CI/CD pipelines; define ownership boundaries with Analytics Engineer
Seniority
Senior, hands-on IC