Senior Data Engineer-4
Core
Design, develop, and deliver end-to-end batch and real-time data pipelines for a global payments technology company.
Role type
Senior individual-contributor data engineer
Builds
Scalable data pipelines, transformation architectures, and data observability frameworks for the fintech marketplace
Domain
Fintech / Payments / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
Databricks administration, PySpark, dbt, CI/CD (GitLab, Jenkins), DataOps, real-time streaming (Kafka, Spark Structured Streaming), SQL, cloud infrastructure (AWS/Azure/GCP), mentoring
Preferred skills
Banking/payment processing domain experience, SaaS and premises-based architecture exposure
Technologies
Databricks, Spark, Python, PySpark, dbt, GitLab, Jenkins, Kafka, AWS, Azure, GCP
Responsibilities
Own end-to-end design and delivery of complex data pipelines; Drive dbt-based transformation architecture with TDD; Administer and optimize Databricks objects and platform; Establish data observability frameworks; Lead design of real-time data streaming pipelines; Mentor junior and mid-level engineers; Partner with stakeholders on requirements and technical trade-offs
Seniority
Senior, hands-on IC with mentorship responsibilities
