Engineer I, Data Engineering
Core
Design and develop scalable ETL pipelines and complex SQL transformations on Cloud platforms to ingest, process, and analyze big data for business decision-making.
Role type
Data Engineer (ETL & Cloud)
Builds
Custom ETL pipelines, data ingestion systems, and data analysis infrastructure on Cloud platforms.
Domain
Big Data, Cloud Computing, Data Engineering
Required skills
Python, SQL, BigQuery, Kubernetes, Apache Airflow, GitHub, VS Code, A/B testing, data visualization tools (Superset, Tableau, PowerBI, Jupyterlab)
Preferred skills
Data modeling, predictive modeling, software security implementation, job scheduling and monitoring
Technologies
GCP, BigQuery, Kubernetes, Composer, Apache Airflow, GitHub, VS Code, Superset, Jupyterlab, Tableau, PowerBI, Jira, Confluence
Responsibilities
Design and develop scalable ETL pipelines using big data technologies on Cloud platforms; Develop complex SQL transformations and code optimization on BigQuery; Provide production support, job scheduling/monitoring, and data quality reporting; Establish and operate software infrastructure to collect and analyze big data; Implement software security systems to protect data integrity.
Seniority
Mid-level, hands-on IC