Data Engineer (Generative AI & Healthcare Data)
Core
Design, build, deploy, and operate data pipelines, platform services, and production generative AI applications for public health and healthcare data.
Role type
Mid-level individual contributor data engineer (generative AI)
Builds
Cloud data platforms, data pipelines, and generative AI applications for public health agencies
Domain
Healthcare + Generative AI
Deliverable
production ML models
Required skills
Python, SQL, Cloud platforms (AWS/Azure), Databricks, Spark, CI/CD, Generative AI frameworks (LangChain/LlamaIndex), Vector search, HIPAA compliance
Preferred skills
Databricks Certified Generative AI Engineer Associate, Mosaic AI, Unity Catalog
Technologies
Databricks, AWS, Azure, Python, SQL, Spark, LangChain, LlamaIndex, MLflow, Azure OpenAI
Responsibilities
Design and operate cloud data platform components; develop production code and APIs; own CI/CD for data pipelines and AI apps; implement infrastructure as code; build ingestion and transformation pipelines for healthcare data; implement data quality rules and monitoring; develop LLM applications and agentic workflows; apply privacy by design and HIPAA controls; serve as technical lead and mentor colleagues.
Seniority
Mid-level, hands-on IC