Evidentiality Framework for AI
Download .md

Case study

Chicago Sun-Times and Philadelphia Inquirer: A Summer Reading List of Books That Don’t Exist

In May 2025, two big US newspapers printed a summer reading list. Ten of the fifteen books didn’t exist. A freelance writer had used AI, and nobody along the way checked.

What are the labels? The Evidentiality Framework asks an AI to mark each claim it writes: (g) generated, its own work; (u) given, passed to it by someone else; or (m) checked against a named source. The marks stay on a claim while people work with it. How the labels work.


What Happened


Follow the Claim

This is an illustration of how the labels would have worked, not a test. It only holds if the conditions under “What Would Have Had to Be True” held.

Follow one book: from an AI tool to two newspapers

Key: as it happened, the type gets bigger as the claim sounds more certain. With labels: red (g) generated: written by the AI; green (u) given: passed on, with who said it; blue (m) checked against a named source.

As it happenedWith labels
Spring 2025 · AI tool → writer
As it happened“The Rainmakers” by Percival EverettA real author, a book that sounds right.
With labels(g)“The Rainmakers” by Percival Everett(/g)If the tool used the labels: marked as written by the AI.
Spring 2025 · Writer → King Features
As it happenedDelivered as part of a summer sectionNow it’s content a company sells.
With labels(u)“The Rainmakers” by Percival Everett(/u: AI tool, unconfirmed)Passed on with where it came from, and that nobody has checked it.
Before 15 May 2025 · The check
As it happenedNobody looked the books upNo editor at the newspapers saw it.
With labels(m)Percival Everett has no book called “The Rainmakers”(/m: Percival Everett, as reported by WBEZ, checked 3 Oct 2026)This check could be made at the time. We name the source that confirmed it later.
15–18 May 2025 · King Features → two newspapers
As it happenedPrinted under two newspapers’ namesNow it carries a newspaper’s trust.
With labelsLeft out. The check found nothing, so the claim never reaches the finished document.Finished documents carry no labels. They only carry claims that passed the check.

The book does not exist. The title and author are as printed, as reported by WBEZ.


How the Labels Could Have Helped


What Would Have Had to Be True

The four conditions every case shares: the AI tool used the labels; it labelled its own work correctly (the weakest link: in our tests, AI sometimes mislabels its own work); the label stayed on when the text was copied; and someone owned a rule that unchecked claims don’t go further. In this case:


What Already Existed


What the Labels Wouldn’t Have Caught


Further Reading

Next: All case studies · How the labels work