Data Engineer
Core
Ingests, cleanses, organizes, and transforms data from internal and external sources using cloud-native platforms and AI/ML techniques to generate insights for healthcare members.
Role type
Senior Data Engineer (Cloud & Big Data)
Builds
Data processing pipelines, software tools leveraging AI/ML, and APIs exposing large datasets.
Domain
Healthcare / Big Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Databricks, Spark, Scala, SQL, Azure Cloud (ADF, Synapse, ADLS), CI/CD, Test Automation, Software Development
Preferred skills
Terraform
Technologies
Databricks, Spark, Scala, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Terraform
Responsibilities
Ingest data from internal and external sources; Develop software tools leveraging AI/ML; Design, develop, and test data processing pipelines; Expose large datasets via APIs; Document database design and performance processes.
Seniority
Senior, hands-on IC