Principal Data Engineer, LLM/AI Platforms
Core
Architect and optimize data platforms supporting LLMs, RAG, and agentic systems at massive scale.
Role type
Principal Data Engineer (LLM/AI Platforms)
Builds
Production-grade data infrastructure for next-generation AI platforms
Domain
Artificial Intelligence / Large Language Models / Distributed Systems
Deliverable
production ML models
Required skills
LLM engineering, distributed data processing, cloud platforms, containerization, messaging systems, data warehousing, MLOps, agentic AI frameworks
Preferred skills
Production LLM deployment, cybersecurity, open-source contributions
Technologies
Python, JVM, Spark, Dask, Flink, AWS, GCP, OCI, Docker, Kubernetes, Kafka, Pulsar, Snowflake, BigQuery, Airflow, Kubeflow, MLflow, SageMaker, Vertex AI, LangChain, LlamaIndex
Responsibilities
Architect and optimize data platforms for LLMs and agentic systems; Drive adoption of agentic workflows; Design scalable and fault-tolerant data solutions; Develop production-ready code with high performance; Provide technical leadership in data modeling and architecture; Establish MLOps and DataOps best practices; Own end-to-end lifecycle of critical data services; Collaborate with cross-functional teams to transform prototypes into services; Lead technical workshops and mentor engineers; Champion DevSecOps practices.
Seniority
Principal, hands-on IC with technical leadership
