About the role
QA Tester – AI Observability & Monitoring (2 Positions)
Experience: 5-7 Years
Location: Offshore
Role Type: Contract
We are seeking experienced QA professionals with 5-7 years of testing/validation experience and exposure to AI/ML systems, GenAI/LLM testing, observability platforms, API testing, and data validation.
Key skills and experience include:
- AI/ML systems, GenAI/LLM testing, and model evaluation
- AI observability and monitoring platforms (e.g., Langfuse)
- API testing, backend validation, and SQL/data validation
- Model performance monitoring, drift detection, and validation
- Functional and non-functional testing of AI applications
- Test management tools (QTest, ALM, etc.)
- Python-based test automation concepts
- AI governance, explainability, compliance, and regulated environments
- Candidates with experience in Generative AI, prompt evaluation, Responsible AI practices, and AI monitoring frameworks