DevOps / DataOps Engineer – Databricks Platform | Senior (Remote)
Core
Design, implement, and evolve the end-to-end CI/CD pipeline for the Databricks platform, ensuring automated artifact promotion between development, staging, and production environments.
Role type
Senior DevOps / DataOps Engineer (Databricks Platform)
Builds
Automated CI/CD pipelines, reusable deployment templates, and IaC-managed Databricks infrastructure
Domain
Data Engineering / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Databricks Asset Bundles, Terraform (Databricks provider), Python (advanced), CI/CD as code (GitHub Actions, GitLab CI, Bitbucket Pipelines), Git strategies, SQL, automated testing (Pytest), observability tools (Datadog)
Preferred skills
Legacy Data Warehouse to Lakehouse migration, Unity Catalog governance, AWS or Azure cloud environments
Responsibilities
Design and evolve CI/CD pipelines for Databricks; Standardize workload packaging and deployment using Databricks Asset Bundles; Implement and maintain Infrastructure as Code (IaC) with Terraform; Define versioning, branching, and release management strategies; Build and maintain pipelines as code with automated quality gates; Automate governance and security controls; Disseminate software engineering best practices; Contribute to architectural decisions and technical mentorship; Support monitoring and troubleshooting of pipelines and infrastructure
Seniority
Senior, hands-on IC
