Data Quality Engineer
Core
Design and implement data quality frameworks and automated checks across Bronze, Silver, and Gold data layers to ensure reliability and consistency.
Role type
Data Quality Engineer
Builds
Automated data quality checks, validation rules, and reconciliation processes for data pipelines
Domain
Cloud data platforms (Azure, Databricks)
Deliverable
production ML models | product features
Required skills
Azure, Databricks, SQL, data quality frameworks, ETL/ELT validation, layered architecture (Bronze/Silver/Gold), pipeline monitoring, alerting, root cause analysis
Preferred skills
Identity resolution, UAT support, QA documentation
Technologies
Azure, Databricks
Responsibilities
Design and implement data quality frameworks; Build and maintain automated data quality checks; Own reconciliation between source systems and Databricks layers; Validate identity resolution outputs; Perform end-to-end pipeline testing; Partner with Data Engineers to define acceptance criteria; Support UAT with client business stakeholders; Document QA processes and results; Monitor pipeline health post-deployment
Seniority
Mid-level, hands-on IC
