Senior Manager, QA & Analytic Engineer (Contract till 31st Dec 2028)
Core
Own end-to-end testing lifecycle and data strategy for a Parent Engagement Digital Assistant (AI-powered tool) to ensure quality, safety, and trustworthiness.
Role type
Senior Manager, QA & Analytic Engineer (AI)
Builds
Parent Engagement Digital Assistant (AI chatbot/digital assistant)
Domain
Public sector health promotion / Conversational AI
Deliverable
production ML models
Required skills
AI quality assurance, regression testing, agentic AI evaluation, data analysis, dashboard creation, Python, SQL, Power BI, Tableau, safety & bias assessment
Preferred skills
Experience with conversational AI/chatbots, academic training in data analytics or computer science
Technologies
Python, SQL, Power BI, Tableau
Responsibilities
Design and execute structured test cases for accuracy, tone, safety, and data privacy; Perform full regression testing after model changes; Evaluate external agentic AI tools using a scoring framework; Analyze conversation logs to surface patterns and build live performance dashboards
Seniority
Senior, hands-on IC