Senior AI QA Automation Engineer

Build automated evaluation frameworks for AI agents, including benchmark datasets and evaluation metrics. Test AI-specific behaviors such as hallucinations and citation accuracy. Develop QA solutions for test-case generation and API validation, while implementing CI/CD quality gates and monitoring production AI quality.

5+ years of experience in Software Quality Engineering or Test Automation. Strong Python skills and hands-on experience with Playwright and/or Selenium. Bachelor's degree in Computer Science or a related field. Experience with Azure AI Foundry Evaluations and defining evaluation metrics.

We offer a fully remote position with flexible working hours. At Coforge, we hire professionals based solely on their skills and do not discriminate based on various factors.