DATA ENGINEER III
Core
Building scalable data pipelines, infrastructure, and integrations for global projects to drive data-driven decision-making.
Role type
Senior Data Engineer
Builds
Scalable data pipelines, data infrastructure, and application integrations
Domain
Financial technology / Big Data
Deliverable
production ML models | product features
Required skills
Python, SQL, Apache Spark (PySpark), AWS, Apache Kafka, Apache Airflow, relational and NoSQL databases, data lakes/warehouses, distributed systems architecture, batch and streaming processing, Git, clean code practices
Preferred skills
Datahub, Kubernetes
Technologies
AWS (S3, Glue, EMR, Redshift), Terraform, Apache Spark, Apache Kafka, Apache Airflow, MySQL, PostgreSQL, MongoDB
Responsibilities
Implement scalable and efficient data pipelines; monitor resources and costs of developed solutions; develop code and solutions focusing on clean code and best practices; provision data-related infrastructure using Terraform; optimize data pipelines; provide integrations of applications and data services between systems; collaborate with engineering, science, and analysis teams to develop data solutions.
Seniority
Senior, hands-on IC