Data Engineer
Core
Design, build, and optimize data pipelines and architectures to transform data into business insights.
Role type
Data Engineer
Builds
Data Lake, data warehouses, and analytical environments
Domain
Cloud data engineering and analytics
Deliverable
production ML models | product features
Required skills
SQL, Python, PySpark, data modeling, ETL/ELT, data governance, data quality, data security, code versioning, testing
Preferred skills
Azure, Databricks, generative AI tools (Claude Code), data governance frameworks
Technologies
Azure, Databricks, SQL, Python, PySpark, Git
Responsibilities
Analyze and interpret data to generate business-relevant information; Develop, maintain, and optimize data pipelines and ETL/ELT processes; Design and evolve solutions for Data Lake, data warehouses, and analytical environments; Ensure data quality, integrity, availability, security, and compliance; Identify opportunities for automation and continuous improvement in data processes; Collaborate with data scientists, technical teams, and business areas to deliver scalable solutions; Utilize AI tools like Claude Code to support coding, review, documentation, testing, optimization, and standardization; Contribute to best practices for safe and productive AI use in production environments
Seniority
Mid-level to Senior, hands-on IC
