A Google spokesperson said AI Overviews are designed to display information supported by top web results, and that they have an accuracy rate comparable to other search features.

We know this because folks online have noticed you can ask Google about any faux idiom — any random, nonsense saying you make up — and Google AI Overviews will often prescribe its meaning. That's not exactly surprising, as AI has shown a penchant for either hallucinating or inventing stuff in an effort to provide answers with insufficient data.

Google's AI Overviews is confidently hallucinating meanings for made-up phrases, raising concerns about the reliability of search results.