Senior Scala Data Engineer
Core
Design, develop, and maintain scalable data-processing applications and pipelines using Scala and Apache Spark in cloud environments.
Role type
Senior IC Scala Data Engineer
Builds
Large-scale batch and real-time data-processing frameworks and event-driven architectures
Domain
Cloud-native big data engineering
Required skills
Scala, Apache Spark, SQL, AWS, Apache Kafka, distributed systems, data structures, algorithms
Preferred skills
Spark Streaming, Structured Streaming, Docker, Kubernetes, CI/CD, DevOps, data lakes
Technologies
AWS, Apache Spark, Apache Kafka, Hadoop, Docker, Kubernetes, Git, SQL
Responsibilities
Design and optimize scalable data pipelines; build batch and real-time processing frameworks; implement event-driven architectures with Kafka; write and optimize complex SQL queries; deploy and monitor applications on AWS; troubleshoot production issues; participate in code reviews and establish technical standards
Seniority
Senior, hands-on IC