AI Data Engineer – Migration
Core
Design and develop data migration and modernisation pipelines using AI-assisted and agent-based solutions for data discovery, schema mapping, transformation, and validation.
Role type
Senior IC AI Data Engineer (Migration)
Builds
Data migration pipelines, AI/agentic workflows, APIs, and data services for cloud environments.
Domain
Data Engineering + AI/LLMs + Cloud Modernisation
Deliverable
production ML models | product features
Required skills
Python, SQL, ETL/ELT pipeline design, Cloud data platforms (AWS/Azure/GCP), AI/LLM/Agentic concepts, API development, Microservices, Docker, CI/CD
Preferred skills
LangChain/LangGraph/AutoGen/CrewAI/LlamaIndex, LLM APIs, Prompt engineering, RAG, Vector Databases, Spark/PySpark, dbt, Airflow, Snowflake/BigQuery/Databricks, Legacy-to-modern migration, Data quality frameworks
Technologies
Python, SQL, AWS, Azure, GCP, Docker, CI/CD, LangChain, LangGraph, AutoGen, CrewAI, LlamaIndex, OpenAI, Anthropic, Spark, PySpark, dbt, Airflow, Snowflake, BigQuery, Databricks
Responsibilities
Design and develop data migration and modernisation pipelines; Work with AI agents to automate data discovery, schema mapping, transformation and validation; Integrate AI/agentic workflows with traditional Data Engineering platforms; Analyse legacy data structures and support migration to modern cloud environments; Build data-quality, validation and human-in-the-loop processes; Develop and integrate APIs and data services
Seniority
Senior, hands-on IC
