There’s no arguing that AI still has quite a few unreliable moments, but one would hope that at least its evaluations would be accurate. However, last week Google allegedly instructed contract workers evaluating Gemini not to skip any prompts, regardless of their expertise, TechCrunch reportsbased on internal guidance it viewed. Google shared a preview of Gemini 2.0 earlier this month.
Google reportedly instructed GlobalLogic, an outsourcing firm whose contractors evaluate AI-generated output, not to have reviewers skip prompts outside of their expertise. Previously, contractors could choose to skip any prompt that fell far out of their expertise — such as asking a doctor about laws. The guidelines had stated, ”If you do not have critical expertise (e.g. coding, math) to rate this prompt, please skip this task.”
Källa: Google accused of using novices to fact-check Gemini’s AI answers
