GCP Data Engineer
Core
Designing, building, and supporting distributed systems and large-scale data processing systems in production for banking, financial, and energy sectors.
Role type
Senior GCP Data Engineer
Builds
Batch and streaming data pipelines on Google Cloud
Domain
Financial services, Energy, Big Data
Required skills
GCP Data Products (BigQuery, Dataflow, Cloud Storage, Pub/Sub, Cloud Composer), Apache Kafka, Python, SQL, Java, Scala, Go, Spark, Flink, Beam, Hadoop, Docker, Kubernetes, CI/CD (Jenkins, GitHub, Spinnaker)
Preferred skills
GCP Certifications (Cloud Architect, Cloud Developer, Professional Data Engineer), Apache Kafka CCDAK certification
Technologies
Google Cloud Platform, Apache Kafka, Spark, Flink, Beam, Hadoop, Docker, Kubernetes, Jenkins, GitHub, Spinnaker
Responsibilities
Design and build distributed systems and large-scale data processing systems; Develop batch and streaming data pipelines; Write complex SQL queries; Manage operational data stores, data warehouses, and data lakes; Implement automation and CI/CD pipelines; Lead feature teams to deliver outcomes.
Seniority
Senior, hands-on IC