UAT Testing
Core
Design, develop, and maintain scalable UI and API automation frameworks for AI-driven applications, agentic AI workflows, and LLM-powered systems.
Role type
Senior UI/API Automation Engineer (AI/LLM focus)
Builds
Reusable automation components, evaluation frameworks for AI response quality, and integrated CI/CD test suites
Domain
Artificial Intelligence, Large Language Models, Agentic Workflows, Banking, Insurance, Payment Services, Energy
Required skills
UI and API test automation, Playwright, TypeScript, agentic AI testing, LLM evaluation frameworks, REST API testing, CI/CD integration, defect tracking, root cause analysis, test strategy design
Preferred skills
Mentoring junior QA engineers, automation best practices
Technologies
Playwright, TypeScript, REST APIs, CI/CD pipelines
Responsibilities
Design and execute test strategies for AI models, prompts, and autonomous agent behaviors; Automate functional, regression, smoke, integration, and end-to-end test scenarios; Develop evaluation frameworks for AI response quality, accuracy, reliability, safety, and performance; Integrate automation suites into CI/CD pipelines; Perform defect tracking, root cause analysis, and issue-resolution support; Prepare test plans, test cases, automation scripts, execution reports, and quality metrics
Seniority
Senior, hands-on IC
