UI/UX testing
XPT Software
Key responsibilities
- Perform manual UI/UX testing of AI-driven features and embedded agents across the SaaS platform
- Design and execute test scenarios for AI agent interactions, prompts, and outputs
- Create and manage test data and test environments to simulate realistic business scenarios
- Validate AI agent outputs using defined evaluation criteria and metrics, including vendor-provided test cases
- Collaborate with product, engineering, and vendor teams to identify defects and improve user experience
- Review and refine test strategies for AI features, including edge cases and behavioral testing
Mandatory skills
- 10+ years of experience in testing, with strong exposure to UI/UX testing (Lead Tester level)
- Strong ability to design test scenarios and test data independently
- Experience in manual testing of complex enterprise/SaaS applications
- Ability to evaluate AI outputs and test results with a critical, user-focused approach
- Basic understanding of Generative AI, LLMs, prompt engineering, and AI evaluation concepts
- Strong communication and stakeholder coordination skills; self-driven and confident
Preferred skills
- Experience in AI agent testing / AI testing tools
- Exposure to GenAI/AI-ML products or intelligent automation platforms
- Domain experience in Demand Management (e.g., ServiceNow)
- Familiarity with AI evaluation metrics (accuracy, relevance, hallucination detection, etc)
- Experience working with SaaS platforms and product-based delivery models