Data Platform Engineer, Emerging Technology Solutions
Core
Design, build, and maintain high-throughput batch and real-time data pipelines and scalable platform infrastructure for security telemetry processing and anti-abuse services.
Role type
Senior Data Platform Engineer (Security)
Builds
Scalable micro-services, data pipelines, and platform infrastructure for anti-phishing, spam, and social engineering attack prevention.
Domain
Cybersecurity / Big Data / Distributed Systems
Required skills
Java, Python, Scala, NoSQL (Cassandra, Redis, MongoDB), streaming/batch frameworks (Kafka, Spark, Flink), distributed systems, micro-services architecture, RESTful design, containerization, CI/CD automation, cloud orchestration
Preferred skills
AI/ML system integration at scale, automated failover and disaster recovery engineering, high-availability production system resilience
Technologies
Kafka, Spark, Flink, Cassandra, Redis, MongoDB, Docker, Kubernetes
Responsibilities
Design and maintain high-throughput data pipelines for security telemetry; Architect and scale robust micro-services for anti-abuse services; Own services from coding to production deployment and maintenance; Implement automated testing, auto-healing, and CI/CD pipelines; Optimize distributed NoSQL and in-memory datastores for real-time risk scoring; Establish telemetry and logging frameworks for system observability.
Seniority
Senior, hands-on IC
