Engenheiro(a) de Dados Sênior (Databricks)
Core
Build and evolve a modern data platform focused on large-scale data ingestion, processing, and availability.
Role type
Senior hands-on data engineer (Databricks)
Builds
Robust and scalable data pipelines for corporate data ecosystems
Domain
Data engineering / Data lakehouse
Deliverable
production ML models | product features
Required skills
Databricks, Apache Spark (PySpark/Scala), Python, SQL, Data Lake/Lakehouse, Git, CI/CD, Data modeling
Preferred skills
Unity Catalog, Terraform, Kafka/Event Hubs, Datadog, Airflow
Technologies
Databricks, Delta Lake, Spark Structured Streaming, REST APIs
Responsibilities
Develop and maintain batch and streaming data ingestion pipelines; Design and implement data integration solutions from multiple sources; Build and optimize processes using Apache Spark; Ensure quality, reliability, and performance of pipelines; Act on data modeling and organization in Lakehouse architectures; Conduct troubleshooting and performance optimization for critical data processes.
Seniority
Senior, hands-on IC