BR Data Engineer
Core
Design, build, and maintain scalable data pipelines and infrastructure to support data ingestion, transformation, and delivery for analytics and machine learning workloads.
Role type
Senior Data Engineer
Builds
ETL/ELT pipelines, data lakes, and cloud-based data services
Domain
Cloud data engineering and infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, cloud platforms (AWS/Azure/GCP), data orchestration (Airflow/Prefect), containerization (Docker/Kubernetes), API development, database management (SQL/NoSQL), CI/CD pipelines
Preferred skills
Experience with streaming data (Kafka/Spark/Flink), Infrastructure as Code (Terraform/CloudFormation), unit testing frameworks
Technologies
Python, SQL, AWS, Azure, GCP, Airflow, Prefect, PostgreSQL, BigQuery, Redshift, S3, Azure Data Lake, Docker, Kubernetes, Git, Flask, FastAPI, Django, Kafka, Spark, Flink, Terraform, CloudFormation
Responsibilities
Develop reusable scripts for data ingestion and transformation; build and maintain ETL/ELT pipelines; manage cloud infrastructure and security permissions; create and maintain data services and APIs; ensure data quality and pipeline reliability through monitoring and logging; collaborate with data scientists and analysts on data workflows.
Seniority
Senior, hands-on IC
