pull down to refresh

Generative search engines often cite sites that wouldn’t appear in Google’s top 100 links.
Since last year’s disastrous rollout of Google’s AI Overviews, the world at large has been aware of how AI-powered search results can differ wildly from the traditional list of links search engines have generated for decades. Now, new research helps quantify that difference, showing that AI search engines tend to cite less popular websites and ones that wouldn’t even appear in the Top 100 links listed in an “organic” Google search.
In the pre-print paper “Characterizing Web Search in The Age of Generative AI”, researchers from Ruhr University in Bochum, Germany, and the Max Planck Institute for Software Systems compared traditional link results from Google’s search engine to its AI Overviews and Gemini-2.5-Flash. The researchers also looked at GPT-4o’s web search mode and the separate “GPT-4o with Search Tool,” which resorts to searching the web only when the LLM decides it needs information found outside its own pre-trained data.
The researchers drew test queries from a number of sources, including specific questions submitted to ChatGPT in the WildChat dataset, general political topics listed on AllSides, and products included in the 100 most-searched Amazon products list.
54 sats \ 4 replies \ @optimism 11h
I'm not sure if "top 100" is a qualifier though. If we search google for the literal title of the top ~AI post (#1062431) on SN this year, it's not in the top 100 results either (when logged out)
reply
reply
44 sats \ 2 replies \ @optimism 11h
With quotes, sure. But then you're already searching for something you know exists, not asking?
Maybe my use of the word literal is incorrect here.
reply
Haha. It was an joke attempt! I get what you're saying, not sure if the top 100 is the best comparison either. We gotta keep in mind that search algorithms are different and Google has its own bias too. I just see that study as a way to compare things, nothing more.
reply
55 sats \ 0 replies \ @optimism 11h
Of course! lol
I just see that study as a way to compare things, nothing more.
I see it as: wow, AI broke Google's listing extortion scheme. lol
reply