Source: CrawlJobs

UAT Testing - Advanced

Capco Mumbai, India
On-site work

Publication date: 03/11/2026

We are seeking a highly skilled Senior QA Automation Engineer with 10+ years of experience in software testing and automation. The ideal candidate should have strong expertise in UI and API test automation using Playwright with TypeScript and hands-on experience in Agentic AI testing, including AI-driven workflows, Large Language Models (LLMs), AI agents, and evaluation frameworks. The candidate will play a key role in designing, developing, and maintaining scalable automation frameworks while ensuring the quality of modern AI-powered applications. Domain knowledge and skills is a must.

Responsibilities

Design, develop, and maintain robust UI and API automation frameworks using Playwright and TypeScript; Automate functional, regression, smoke, integration, and end-to-end test scenarios; Build reusable automation components and improve framework scalability and maintainability; Validate AI-driven applications, Agentic AI workflows, LLM-powered systems, and intelligent agents; Design and execute test strategies for AI models, prompts, workflows, and autonomous agent behaviors; Perform functional, integration, regression, and end-to-end testing for AI-based applications; Develop and execute evaluation frameworks to measure AI response quality, accuracy, reliability, safety, and performance; Automate API testing using REST APIs and validate request/response payloads; Collaborate with developers, product owners, business analysts, and AI/ML teams to understand business and technical requirements; Integrate automation suites into CI/CD pipelines and ensure continuous quality delivery; Perform defect tracking, root cause analysis, and support issue resolution; Prepare test plans, test cases, automation scripts, execution reports, and quality metrics; Mentor junior QA engineers and contribute to automation best practices

Requirements

10+ years of experience in software testing and automation; Strong expertise in UI and API test automation using Playwright with TypeScript; Hands-on experience in Agentic AI testing, including AI-driven workflows, Large Language Models (LLMs), AI agents, and evaluation frameworks; Domain knowledge and skills is a must
Apply with employer

Similar offers

All →

Cookie settings

Each purpose is optional and off by default. You can withdraw consent at any time.

Showing offers closest to you