Job description

About Our Client

We are recruiting on behalf of our client for an experienced Senior QA / Test Engineer to drive quality assurance and production readiness across a complex, AI-enabled digital platform.

You will define and execute test strategies across application functionality, workflows and integrations, working closely with engineering, product and operational teams throughout the development lifecycle. The role combines traditional software testing with the evaluation of AI and retrieval-based functionality.

Due to the nature of the programme, candidates must hold current SC Clearance.

What You'll Be Doing

Define and execute test strategies covering functional, integration, regression and end-to-end testing.
Develop and maintain automated test coverage across applications, APIs and workflows.
Support UAT, defect management, release testing and production readiness.
Test APIs and integrations across internal and external services.
Validate AI-generated outputs for accuracy, relevance, consistency and grounding.
Assess RAG and retrieval performance, ensuring relevant information is retrieved and used appropriately.
Establish repeatable evaluation approaches and datasets for AI-enabled functionality.
Work with engineering teams to investigate, reproduce and resolve defects.
Provide clear quality evidence to support release and go-live decisions.

What We're Looking For

Strong experience in QA, Test Engineering or Test Automation within production applications.
Experience with test automation frameworks such as Playwright, Cypress or Selenium.
Strong API and integration testing skills using tools such as Postman.
Experience with SQL, CI/CD and defect management tooling such as Jira or Azure DevOps.
Good technical understanding of web applications, APIs and modern application architectures.
Experience testing Generative AI, LLM or RAG solutions would be highly desirable.
Understanding of AI evaluation concepts including groundedness, relevance, hallucination testing and retrieval quality.
Python, TypeScript/JavaScript or similar scripting experience would be advantageous.
Strong analytical, problem-solving and stakeholder communication skills.