AI Spam Bot Story Submissions
Feb. 23rd, 2023 07:46 amA Concerning Trend
http://neil-clarke.com/a-concerning-trend/
What I can say is that the number of spam submissions resulting in bans has hit 38% this month. While rejecting and banning these submissions has been simple, it’s growing at a rate that will necessitate changes. To make matters worse, the technology is only going to get better, so detection will become more challenging. (I have no doubt that several rejected stories have already evaded detection or were cases where we simply erred on the side of caution.)
Yes, there are tools out there for detecting plagiarized and machine-written text, but they are prone to false negatives and positives. One of the companies selling these services is even playing both sides, offering a tool to help authors prevent detection. Even if used solely for preliminary scoring and later reviewed by staff, automating these third-party tools into a submissions process would be costly. I don’t think any of the short fiction markets can currently afford the expense.
Clarkesworld Magazine recently had to close submissions because of a rapid increase in AI-generated stories. The problem is not that the AI-generated nature of the stories isn't obvious; it's that this is a ton of spam.
My first response is that this sucks, and I can sympathize. There's been a steady increase in spambots on Twitter and Tumblr since around November 2022, and this month I've been having to report and block several dozen of them a day. A lot of these bots seem like real people at first glance, but their posts are filled with AI-generated junk. Dealing with them is a shitty meaningless chore, and I hate it.
My second response is that it's difficult to talk about how garbage AI-generated text actually is. A lot of people at my university seem to be seriously convinced that software like ChatGPT is the death of the author, which is wild. The reverse-translated passage that Neil Clarke excerpts at the beginning of this post is a good representative of what AI-generated text actually looks like, and I'd hope that this would be enough to convince people not to worry.
http://neil-clarke.com/a-concerning-trend/
What I can say is that the number of spam submissions resulting in bans has hit 38% this month. While rejecting and banning these submissions has been simple, it’s growing at a rate that will necessitate changes. To make matters worse, the technology is only going to get better, so detection will become more challenging. (I have no doubt that several rejected stories have already evaded detection or were cases where we simply erred on the side of caution.)
Yes, there are tools out there for detecting plagiarized and machine-written text, but they are prone to false negatives and positives. One of the companies selling these services is even playing both sides, offering a tool to help authors prevent detection. Even if used solely for preliminary scoring and later reviewed by staff, automating these third-party tools into a submissions process would be costly. I don’t think any of the short fiction markets can currently afford the expense.
Clarkesworld Magazine recently had to close submissions because of a rapid increase in AI-generated stories. The problem is not that the AI-generated nature of the stories isn't obvious; it's that this is a ton of spam.
My first response is that this sucks, and I can sympathize. There's been a steady increase in spambots on Twitter and Tumblr since around November 2022, and this month I've been having to report and block several dozen of them a day. A lot of these bots seem like real people at first glance, but their posts are filled with AI-generated junk. Dealing with them is a shitty meaningless chore, and I hate it.
My second response is that it's difficult to talk about how garbage AI-generated text actually is. A lot of people at my university seem to be seriously convinced that software like ChatGPT is the death of the author, which is wild. The reverse-translated passage that Neil Clarke excerpts at the beginning of this post is a good representative of what AI-generated text actually looks like, and I'd hope that this would be enough to convince people not to worry.