Staff Data Platform Engineer (AWS, Databricks, Azure, IaC, Solution Architect, Java/Python, 6 - 10 Years)
Core
Design, build, and operate enterprise-scale cloud data platforms supporting the migration of analytical and AI/ML workloads from Hadoop to AWS, Azure, and Databricks.
Role type
Staff Cloud Platform Engineer
Builds
Scalable, secure, and reliable cloud-based data platform services and reusable engineering frameworks
Domain
Cloud Infrastructure & Data Engineering
Deliverable
production ML models
Required skills
Cloud data platform services (AWS EMR, Glue, Azure Databricks, Synapse), Databricks/Lakehouse architecture, Python/Java/Scala, Infrastructure-as-Code (Terraform/CloudFormation), Spark/Hadoop ecosystem, Data governance and security, Linux/Networking, CI/CD automation
Preferred skills
Kubernetes/EKS, Observability and monitoring, Cloud cost optimization, AI/ML platform support, Multi-tenant platform design
Technologies
AWS, Azure, Databricks, Terraform, CloudFormation, Spark, Hadoop, Delta Lake, Unity Catalog, EKS, Kubernetes
Responsibilities
Design and maintain scalable cloud data platform services; Implement data integration pipelines for large volumes of structured/unstructured data; Automate infrastructure provisioning and deployment; Support migration of workloads from Hadoop to cloud; Monitor and optimize platform performance and cost; Provide technical guidance and mentorship to engineers
Seniority
Staff, hands-on IC with strategic impact
