Senior Data Engineer
Core
Designing, building, and optimizing scalable enterprise data solutions on Databricks/AWS to support insurance business processes.
Role type
Senior hands-on IC data engineer
Builds
Production ETL/ELT pipelines, data ingestion frameworks, and Medallion Architecture data products
Domain
Insurance / Financial Services / Cloud Data Engineering
Deliverable
production ML models
Required skills
PySpark, SQL, Databricks, Delta Lake, Parquet, Medallion Architecture, ETL/ELT, data modeling, CI/CD, performance tuning
Preferred skills
Unity Catalog, Auto Loader, CDC, AWS services, AI/ML data workloads, insurance domain knowledge (policy, claims, premium)
Technologies
Databricks, AWS, Azure DevOps, PySpark, SQL, Delta Lake, Parquet
Responsibilities
Design and develop scalable ETL/ELT pipelines; Build batch, incremental, and event-driven ingestion pipelines; Implement automated data reconciliation and quality controls; Translate business requirements into scalable technical designs; Provide technical leadership and mentorship to other engineers; Monitor production pipelines and resolve failures
Seniority
Senior, hands-on IC
