Sr Lead - Cloud Data Engg
Core
Design, build, and maintain scalable, secure, and high-performance cloud-based data platforms supporting analytics, machine learning, and enterprise data needs.
Role type
Senior Lead Cloud Data Platform Engineer
Builds
Cloud-native data platform infrastructure, data pipelines, and reusable automation frameworks for ingestion, transformation, and processing.
Domain
Financial services / Cloud Data Engineering
Deliverable
production ML models
Required skills
Cloud platform design (AWS/Azure), Infrastructure as Code (Terraform), Data pipeline development (Spark, Databricks, Airflow, dbt, Kafka), Data governance and security, CI/CD implementation, Container orchestration (Docker, Kubernetes), SQL, Python/Java/Scala
Preferred skills
AI/ML data pipelines and feature engineering, FinOps principles, Regulated environment experience, Mentorship
Technologies
AWS, Azure, Snowflake, Databricks, Terraform, GitHub Actions, Apache Spark, Apache Airflow, dbt, Kafka, Docker, Kubernetes, Python, Java, Scala, SQL
Responsibilities
Design and implement cloud-native data platform infrastructure; Develop and optimize data pipelines for structured, semi-structured, and unstructured data; Implement data quality, lineage, and cataloging solutions; Manage operational health including monitoring, alerting, and disaster recovery; Partner with data scientists to enable advanced analytics and AI/ML workloads; Mentor junior engineers and contribute to best practices.
Seniority
Senior Lead, hands-on IC with mentorship responsibilities