QA Engineer
Core
Conventional software QA and evaluation engineering for non-deterministic agentic orchestration platforms, ensuring quality of LLM-generated artifacts for SAP implementations.
Role type
Senior QA Engineer (SDET) specializing in AI/LLM evaluation
Builds
Automated end-to-end, integration, and regression test suites; evaluation harnesses with golden datasets and scoring criteria for agent output
Domain
Enterprise software (SAP) + Generative AI/LLM orchestration
Deliverable
production ML models
Required skills
Python, TypeScript, Playwright, Cypress, API testing, CI/CD pipeline management, LLM/ML output evaluation, severity judgment, exploratory testing, defect triage
Preferred skills
SAP testing tooling (Tricentis, Worksoft), performance/load/security testing, bug fixing
Technologies
Python, TypeScript, Playwright, Cypress, CI/CD tools, LLM frameworks
Responsibilities
Own and maintain automated test suites (E2E, integration, regression); build evaluation harnesses for LLM-generated artifacts; define quality gates and release criteria; ensure CI reliability; run exploratory and release testing; triage and drive defects to closure; feed quality signals into product roadmap
Seniority
Senior, hands-on IC
