Quality Evaluator - Fluent English

Interact with different AI models and tools across a wide range of prompts and topics. Compare two or more AI-generated responses side by side. Assess accuracy, helpfulness, instruction-following, clarity, and overall response quality. Write clear, well-reasoned explanations supporting your evaluation decisions.

Fluency in English with strong reading comprehension and writing skills. Extensive hands-on experience using large language models (LLMs) and critically assessing their outputs. Strong analytical judgment and the ability to weigh multiple dimensions of response quality.

Compensation ranges from $7 to $12 per hour. The position is remote and part-time, with a commitment of up to 3 months.