Role Summary
The Test Lead owns test strategy and automation execution for AI-enabled applications, providing technical leadership and ensuring consistent quality across UI, API, and data layers.
Key Responsibilities
• Define an automation first, end to end test strategy covering AI agents, orchestration layers, backend APIs, and UI applications
• Lead and govern Selenium / Playwright based automation frameworks across multi agent workflows, APIs, and portals
• Provide technical guidance and code reviews for Java/Python based automation implementations
• Oversee testing across AI agents and services supporting end‑to‑end automated and analytical workflows.
• Review and guide AI testing coverage, including prompt testing, guardrail validation, response accuracy, and reasoning checks
• Ensure test coverage for System Under test.
• Lead regression planning, defect triage, RCA, reporting, and release sign offs
• Mentor test engineers and ensure consistent QA standards, best practices, and automation quality
Requirements
Required Skills (Must Have)
- Strong automation development experience
- Proficiency in Java or Python
- Expertise in Selenium / Playwright frameworks
- API automation and SQL-based data validation
- Hands-on knowledge of at least one AI testing tool (e.g., Testsigma, Testim, Mabl, Functionize)
- Understanding of cloud‑based platforms (e.g., Microsoft Azure)
- Minimum of 2 years of hands on experience testing GenAI and Agentic AI solutions across production, client facing, or enterprise systems, with involvement in test coordination and review activities.
Good to Have
- ERP / Accounts Payable knowledge (e.g., Oracle ERP, SAP)
- ISTQB certification