Conversation

Notices

1. Embed this notice
   Ars Technica (arstechnica@mastodon.social)'s status on Wednesday, 08-Apr-2026 03:32:32 JST Ars Technica

   Analysis finds Google AI Overviews is wrong 10 percent of the time
   Is 90 percent accuracy good enough for a search robot?
   https://arstechnica.com/google/2026/04/analysis-finds-google-ai-overviews-is-wrong-10-percent-of-the-time/?utm_brand=arstechnica&utm_social-type=owned&utm_source=mastodon&utm_medium=social

   • Embed this notice
     Rich Felker (dalias@hachyderm.io)'s status on Wednesday, 08-Apr-2026 03:32:31 JST Rich Felker

     in reply to

     @arstechnica This isn't even a meaningful claim. Overviews aren't binary "right" or "wrong". Maybe only 10% meet some extreme definition of "wrong", but none of them are accurate because they don't contain the key thing a search is looking for: provenance, a basis for knowing who the claims you're being presented with are coming from. And nearly all have some counterfactual claims.

   • Embed this notice
     Rich Felker (dalias@hachyderm.io)'s status on Wednesday, 08-Apr-2026 05:10:19 JST Rich Felker

     in reply to

     • webhat

     @webhat @arstechnica 🤣

   • Embed this notice
     webhat (webhat@infosec.exchange)'s status on Wednesday, 08-Apr-2026 05:10:20 JST webhat

     in reply to

     • Rich Felker

     @dalias

     Analysis finds @arstechnica is wrong 10 percent of the time
     Is 90 percent accuracy good enough for a news outlet?