10.4% of AI Overview Citations are AI-Generated \ stacker news ~AI

We studied AI Overview citations to find out how many AIO citations are AI-generated within and outside of the top-100 SERPs. These are our findings.

AI Overviews are reshaping how we find and consume information online. In short, they select a handful of key sources and synthesize a short overview of the main facts about a user’s search.

Typically, linked citations are included along with the overview, where users can then click to access more information about the cited source.

However, given AI’s tendency to produce AI hallucinations, such as with the AI book scandal, it raises important questions:

To what extent are AI Overview sources AI-generated?

How much of the citation pool is made up of machine-written content?

In this study, we focused specifically on Google’s AI Overviews.

2 Key Findings

10.4% of citations are AI-generated

48% of citations come from the top 100 organic results

[...]

...read more at originality.ai

33 sats \ 1 reply \ @optimism 7 Sep

Almost every time I read an abstract for a paper on arxiv (multiple times per day), I'm having an underlying feeling that it's "sloppy", either of: written by an LLM, rewritten by a human from an LLM's template, or translated through LLM.

I often need to edit the abstract for readability when I decide to post it here.

So the 30% AI+Unclassifiable is lower than I thought it would be.

100 sats \ 0 replies \ @0xbitcoiner OP 7 Sep

Big problem here: I'm not a native English speaker, so I find it hard to detect sloppy AI.