CareerPlanSign in

Senior Data Engineer

Pune, India💼 Full-time🗓 2026-09-28 → 2026-09-29

Core

Building and maintaining scalable data pipelines and entity-centric data models to support AI/ML model enablement, merchant identity resolution, and unified data registries at petabyte scale.

Role type

Senior IC data engineer (AI/ML infrastructure)

Builds

Production-grade data pipelines, entity-centric data models, and model deployment artifacts for AI/ML systems

Domain

Fintech / Payments / AI/ML infrastructure

Deliverable

production ML models

Required skills

Python, SQL, Apache Spark, Databricks, AWS/GCP, ETL/ELT design, distributed systems, data modeling, CI/CD for ML

Preferred skills

Streaming data pipelines, data governance, metadata management, fraud domain knowledge, real-time observability

Technologies

Databricks, Apache Spark, AWS, GCP

Responsibilities

Design and build data pipelines integrating multiple sources for merchant registry and trust profiles; Partner with data science teams to scale models and features into production; Automate and maintain data workflows in distributed environments; Optimize ETL/ELT processes for high-performance data access; Implement testing frameworks and monitoring for production AI/ML systems; Support incident response and performance tuning of production systems.

Seniority

Senior, hands-on IC

Sourced via workday · Listed on CareerPlan, which tracks 855,000+ jobs from 20+ sources.