In total, the researchers operated dozens of AI bots that made a total of 1,783 comments in the r/changemyview subreddit, which has more than 3.8 million subscribers, over the course of four months. The researchers claimed this was a “very modest” and “negligible” number of comments, but claimed nonetheless that their bots were highly effective at changing minds.

“We note that our comments were consistently well-received by the community, earning over 20,000 total upvotes and 137 deltas,” the researchers wrote on Reddit. Deltas are a user-given “point” in the subreddit when they say that a comment has successfully changed their mind.

In a draft version of their paper, which has not been peer-reviewed, the researchers claim that their bots are more persuasive than a human baseline and “surpass human performance substantially.”

“We feel like this bot was unethically deployed against unaware, non-consenting members of the public,” the moderators of r/changemyview told 404 Media. “No researcher would be allowed to experiment upon random members of the public in any other context.”