Table of contents
In March 2026 Hachette pulled a horror novel called Shy Girl after it was flagged as roughly 78% AI-generated. According to a new paper on AI fiction, it was the first commercially published novel cancelled over AI allegations.
The same paper puts a number on how much AI fiction is already out there. Nearly 20% of a sample of 14,000 self-published Amazon novels were flagged as largely AI-generated. That share jumped 41% year over year, and books are only one corner of the AI-generated content piling up across the web.
So readers already buy machine-written books under human names, and the question is how anyone proves it.
Words are cheap to change
Existing AI detectors lean mostly on style, things like word choice and the famous em-dash.
That signal is fading fast. The authors point out that GPT-5.4 cut its em-dash habit, and they cite earlier work where fine-tuning a model to mimic human style dropped AI detection rates on creative writing from 97% to 3%.
I see this at my own desk, where every Dossier issue goes through a slop checklist and an external checker called Slop Cop before it ships. They catch banned words, lists of three, stacked colons and sentences that trail off into an “-ing” clause. Fix those and the text passes, which only tells me the words got cleaned. Who wrote them is a separate question.
What StoryScope measures instead
Jenna Russell and four co-authors built StoryScope to go a level deeper and ask how AI fiction is built. The team put the StoryScope code on GitHub.
They took 10,272 human stories from Books3 and had Gemini 2.5 Flash reverse-engineer the writing prompt behind each one. That prompt then went to five current models, from Claude Sonnet 4.6 to Kimi K2.5. Every premise ended up with six versions of the story. The full corpus holds 61,608 stories of around 5,000 words each.
Then they stopped looking at words and pulled 304 narrative features across 10 dimensions, such as how the timeline bends and who drives the ending.
Narrative features alone separated human from AI at 93.2% macro-F1.
The habits of AI fiction
The findings read like notes from a tired editor.
AI narrators spell out the theme 77% of the time, against 52% for human narrators. A grieving character’s arc typically ends with the narrator stating the lesson learned.
79% of AI stories have no subplots, against 57% for humans. AI endings land on internal understanding or acceptance in 47% of cases, humans in 27%. Humans write morally ambivalent protagonists more often (59% vs 38%) and leave more endings open.
AI also writes emotion through the body, as physical sensation in 81% of AI stories and 38% of human ones. Smell shows up in 82% of AI stories, against 57% of human ones.
Each model also leaves its own fingerprint on AI fiction, and Claude’s shows as flat pacing, since event intensity escalates less there than in any other source. Claude prefers quiet endings over “avalanche” endings. GPT uses gossip and rumor as a plot device in 64% of stories. Gemini writes the tidiest endings and the bleakest settings, with 88% tagged bleak and oppressive. Kimi sits in the generic middle with no distinctive choices at all.
The bigger result is what the five have in common, or in the paper’s words, AI models “have converged on a shared narrative space”. The human version of a story was the rarest of the six 57.8% of the time, where chance would give 16.7%.
Where most people get this wrong
The easy headline would be that a new detector beats the old ones, and on raw text that’s false. A fine-tuned ModernBERT scored 99.9% on this dataset and TF-IDF with XGBoost scored 99.7%. Style-based classifiers still win today, on this data.
The real story is durability, tested on 278 Gemini stories run through LAMP, a rewriting tool that strips seven categories of AI artifacts like cliché and purple prose. After the cleanup, narrative detection still scored 93.9%, down from 95.5%.
Swapping words is cheap. Changing the plot of AI fiction means rewriting the whole story from the premise up.
The paper has limits too, and the biggest is that naming the exact model is much harder than spotting AI in general, at 68.4% for six-way attribution on narrative features alone. I also didn’t find a test where a model was told outright to write nonlinear, ambiguous fiction full of subplots. That attack on AI fiction detection is the obvious next move.
Why a security person cares about fiction
AI fiction sits outside my field. My reading is threat reports and viral “insider” posts, and the first thing I ask about each one is where it came from.
The logic carries over from AI fiction to anything written to persuade. Influence operations run on generated text too, and nothing stops the same word-level cleanup there. Structure asks harder questions, like whether every piece ends with the moral spelled out or whether every “witness” settles their doubts by the last paragraph. Real accounts usually leave something messy.
Those questions need a habit of asking them, and the habit is free.
So treat any “78% AI” score as a lead and check the plot before you trust the percentage.
Source | https://arxiv.org/abs/2604.03136
Leave a Reply