Data Engineer
Core
Build and maintain the core data lake platform, ingesting high-volume network and customer data to create clean, reliable datasets for business reporting and analytics.
Role type
Senior Data Engineer
Builds
S3-based data lake, curated datasets, and ETL/ELT pipelines
Domain
Telecommunications / Big Data
Required skills
SQL (window functions, CTEs, optimization), Python (ETL, automation), AWS S3/Glue/Athena, Data Modeling (dimensional), Kafka (streaming), Data Quality checks
Preferred skills
Airflow (DAGs, backfills), dbt, Apache Iceberg, Regulated data environments
Technologies
AWS S3, Glue, Athena, Kafka, dbt, Airflow, Python, SQL
Responsibilities
Develop and implement data models ensuring accuracy and consistency; Create and optimize ETL/ELT pipelines into S3 data lake; Consume from and build logic around Kafka topics; Own data transformations in dbt with tests and documentation; Orchestrate and monitor pipelines in Airflow; Write efficient SQL for transformation and investigation; Contribute to data quality checks and flag anomalies; Create and maintain technical documentation.