ADF Data Engineer
Core
Design, build, and maintain ETL/ELT pipelines in Microsoft Fabric to aggregate, harmonize, and normalize data for data science, analytics, and reporting.
Role type
Senior Data Engineer (Microsoft Fabric/Azure)
Builds
Production-ready data pipelines, model-ready datasets, and validated data solutions within Microsoft Fabric and Azure.
Domain
Cloud Data Engineering (Microsoft Fabric, Azure, Snowflake)
Required skills
Microsoft Fabric (Dataflows Gen2, Lakehouse, Data Factory, Notebooks, Spark), Python/PySpark, SQL, ETL/ELT pipeline design, data modeling, data quality validation, CI/CD (Git, Azure DevOps)
Preferred skills
Power BI, Azure data services
Responsibilities
Design and maintain ETL/ELT pipelines; aggregate and normalize data from multiple sources; develop data transformation logic using Python/PySpark; resolve data quality issues and trace errors to sources; establish automated data validation and monitoring; create model-ready datasets for data science workflows; document data lineage and transformation logic; support CI/CD processes.
Seniority
Senior, hands-on IC