Senior Data Engineer Consultant
Core
Design and build scalable data pipelines and product components using big data technologies and generative AI to support global payment transactions.
Role type
Senior IC data engineer (big data & generative AI)
Builds
Reliable data pipelines, data models, and production-ready application components for global payment systems
Domain
Fintech / Payments / Big Data
Required skills
Apache Spark, Hive, Java, Scala, Python, SQL, NoSQL, Apache Airflow, CI/CD, Generative AI, LLMs, Git, RESTful APIs
Preferred skills
Experience with ChatGPT/Copilot, mentoring junior engineers, security assessment processes
Technologies
Spark, Hive, Airflow, Java, Scala, Python, SQL, NoSQL, Git, CI/CD tools, LLM frameworks
Responsibilities
Design and build product components and data pipelines; translate functional requirements into system designs; lead code reviews and mentor colleagues; develop complex test plans and resolve software defects; collaborate with data scientists and machine learning teams; implement CI/CD pipelines for automated testing and deployment.
Seniority
Senior, hands-on IC with technical leadership
