Data Engineer
Core
Designing and developing a data platform to fulfill business needs, including building new data pipelines, maintaining platforms for batch-loading and real-time visualizations, and ensuring data quality.
Role type
Senior Data Engineer (Cloud & Data Warehousing)
Builds
Data pipelines, data platforms, real-time visualizations, and data warehouse solutions
Domain
Cloud data infrastructure and data warehousing
Required skills
AWS services (S3, Lambda, Glue, DMS, RDS), Snowflake or Redshift, SQL query optimization, data pipeline orchestration (Airflow), data modeling (Inmon, Kimball, Data Vault), object-oriented programming
Preferred skills
Kafka, Git, Terraform, data monitoring/visualization tools, PowerShell, Unix scripting
Technologies
AWS, Snowflake, Redshift, Airflow, Kafka, Terraform, Git, PowerShell, Unix
Responsibilities
Design and develop data pipelines; maintain platforms for batch-loading and real-time visualizations; ensure data quality and consistency; mentor engineers on data modeling standards; troubleshoot incidents; document processes and share knowledge
Seniority
Senior, hands-on IC
