L1 Data Engineer - Remote
Core
Design, build, and maintain scalable data pipelines and infrastructure on Azure/Databricks to support business intelligence and analytics.
Role type
L1 Data Engineer (Cloud Data Platform)
Builds
Scalable ETL/ELT workflows, data ingestion processes, and data models for analytics.
Domain
Cloud Data Engineering (Microsoft Azure, Databricks)
Required skills
Python, PySpark, SQL, Azure Data Factory, Databricks, Data Lake Architecture, Delta Lake, Data Governance
Preferred skills
Terraform, CI/CD, SQL Server migration, Delta Sharing, Lakehouse Federation
Technologies
Azure, Databricks, PySpark, Python, SQL, Azure Data Factory, Azure Synapse Analytics, Delta Lake
Responsibilities
Design and develop scalable data pipelines and ETL/ELT workflows; Build and optimize data ingestion processes; Transform and process large datasets; Write and optimize complex SQL queries; Collaborate on data model implementation; Monitor and troubleshoot pipeline failures; Contribute to data pipeline documentation.
Seniority
Mid-level, hands-on IC