Data Engineer - GCP
Core
Design, develop, and sustain scalable data solutions supporting data generation, collection, processing, and delivery for business processes.
Role type
Senior Data Engineer (GCP)
Builds
Scalable data pipelines and architectures for data availability
Domain
Utilities (Energy) / Cloud Data Engineering
Required skills
Python, SQL, Apache Airflow, Google BigQuery, GCP, Streaming, Batch Processing, CDC, Medallion Architecture
Preferred skills
GitLab CI/CD, Cloud data environments, Utilities sector experience
Technologies
Google Cloud Platform, Google BigQuery, Apache Airflow, GitLab CI/CD
Responsibilities
Design and maintain scalable data pipelines; Ensure data quality and integrity across the processing lifecycle; Implement ETL/ELT processes; Act as a technical Subject Matter Expert; Collaborate with multidisciplinary teams; Support technical decision-making; Develop and optimize scalable data architectures; Lead monitoring and performance initiatives for data pipelines; Document processes and best practices; Evaluate and adopt new technologies.
Seniority
Senior, hands-on IC