Within Source Tracing
When scholarly looking references are fake
Fabricated papers and bibliographic details can make AI summaries look scholarly while hiding an unverifiable evidence trail.
On this page
- Why bibliographies can create false confidence
- How fabricated references enter drafts and summaries
- Checks for papers, authors, journals, and claims
Page outline Jump by section
Introduction
Academic references are meant to do one thing above all else: allow readers to trace a claim back to verifiable evidence. When references are invented, corrupted, or copied inaccurately, that chain of verification breaks. In the context of AI-assisted writing, this problem has become more visible because large language models can generate convincing-looking citations that do not exist, combine details from multiple papers into a fictional source, or misattribute authors, titles, and journals. Researchers have repeatedly documented this behaviour, and recent analyses suggest that fabricated citations are now appearing not only in AI outputs but also in published scholarly literature. [JMIR Mental Health+2PMC]mental.jmir.orgAlthough previous…Read more…
For critical thinking, the danger is not merely that a citation is wrong. The danger is that a scholarly-looking reference can create the appearance of evidence while hiding the fact that the evidence trail is broken. Once that happens, readers, students, journalists, researchers, and even other AI systems may trust claims that cannot actually be checked.
Why bibliographies can create false confidence
References carry authority. A paragraph with footnotes often appears more trustworthy than an unsupported assertion, even when the cited sources have never existed. This creates a specific vulnerability in AI-assisted research: people may evaluate the formatting of a bibliography rather than the reality of the sources behind it.
Studies examining AI-generated academic content have found that fabricated references are often highly plausible. They may contain real author names, realistic journal titles, and publication years that fit the topic. To a casual reader, they look indistinguishable from genuine citations. Researchers studying citation hallucinations have noted that fabricated references can mislead readers, distort scientific understanding, and compromise academic integrity precisely because they imitate the appearance of scholarship. [PMC]pmc.ncbi.nlm.nih.govby J Linardon · 2025 · Cited by 8 — Fabricated references can mislead readers, distort scientific understanding, and compromise the in…
The result is a form of false confidence. A reader who sees ten references may assume that ten pieces of evidence exist. In reality, some or all of those references may be unverifiable. The bibliography becomes a signal of credibility rather than proof of credibility.
How fabricated references enter drafts and summaries
Not every fake reference begins as deliberate fraud. Several pathways repeatedly appear in research and real-world incidents.
AI-generated hallucinations. Large language models are trained to predict plausible text. When asked for references, they may generate citation-like strings that follow academic conventions but do not correspond to real publications. Multiple studies have documented substantial rates of fabricated or inaccurate citations across different models and disciplines. [JMIR Mental Health+2PMC]mental.jmir.orgAlthough previous…Read more…
Copying without verification. A common failure occurs when users accept AI-generated references and insert them into reports, essays, reviews, or papers without checking them against databases such as Crossref, PubMed, Google Scholar, or library catalogues. What begins as a drafting shortcut becomes part of a supposedly evidence-based document. [Duke University Libraries Blogs]blogs.library.duke.educhatgpt and fake citationsThese citations may sound legitimate and scholarly, but they are not…Read more…
Citation corruption. Some references are not entirely invented but become distorted. An AI system might combine the title of one paper with the authors of another, alter publication details, or cite a real journal issue that contains no such article. These errors can be difficult to detect because parts of the citation are genuine. [The Verge]theverge.comThe incident occurred in a defense submitted by Anthropic data scientist Olivia Chen on April 30th, as part of a lawsuit brought by music…
Publication pipeline failures. Once a fabricated citation enters a manuscript, peer review and editorial checks do not always catch it. Recent large-scale analyses suggest that hallucinated references have passed through preprint moderation and journal publication processes in significant numbers. [arXiv+2Retraction Watch]arxiv.orgOpen source on arxiv.org.
What happens when fake references enter the research record
The damage extends beyond a single incorrect footnote.
Researchers waste time chasing evidence that does not exist
A fabricated citation sends readers on a search for a paper that cannot be found. Researchers may spend hours checking databases, reviewing journal archives, or contacting authors before discovering that the source never existed. This wastes effort and slows genuine inquiry. Scholars have warned that hallucinated citations can send researchers down unproductive paths and divert scarce research resources. [Taylor & Francis Online]tandfonline.comTaylor & Francis OnlineHallucinated citations produced by generative artificial…by DB Resnik · 2026 — A hallucinated citation may supp…
Weak claims gain undeserved legitimacy
A claim supported by a reference appears stronger than the same claim without one. If the reference is fabricated, the citation functions as a rhetorical prop rather than evidence. Readers who do not verify the source may accept conclusions that have no documented support. [PMC]pmc.ncbi.nlm.nih.govby J Linardon · 2025 · Cited by 8 — Fabricated references can mislead readers, distort scientific understanding, and compromise the in…
Errors can spread through later publications
One of the most worrying outcomes is citation contamination. If a fabricated reference appears in a paper, report, presentation, or online article, later authors may repeat it. The false citation can acquire apparent legitimacy through repetition even though the original source was fictional. Researchers studying hallucinated citations have warned that these errors can infiltrate knowledge production systems and become difficult to remove once they circulate widely. [arXiv]arxiv.orgOpen source on arxiv.org.
Public trust in expertise erodes
Academic citations are part of the social infrastructure of trust. They allow readers to believe that experts can justify their claims. When fabricated references become common, scepticism spreads beyond the specific errors. Readers may begin to question whether any cited evidence has been checked properly. This weakens confidence not only in AI-generated summaries but also in legitimate scholarship. [MDPI]mdpi.comOpen source on mdpi.com.
Evidence that the problem is growing
Recent studies suggest that fabricated references are no longer isolated mistakes.
A 2026 analysis published in The Lancet examined millions of biomedical references and reported a sharp increase in fabricated citations over recent years. The authors found that papers containing fabricated references became substantially more common between 2023 and 2025, with the rate continuing to rise in early 2026. [The Lancet]thelancet.comThe LancetFabricated citations: an audit across 2·5 million biomedical…by M Topaz · 2026 · Cited by 6 — In 2023, approximately one in…
Another large-scale study examining more than 111 million references across major scholarly repositories estimated that nearly 147,000 hallucinated citations appeared in 2025 alone. The researchers concluded that non-existent references were increasing after widespread adoption of AI writing tools and that existing moderation and publication processes were catching only a fraction of them. [arXiv]arxiv.orgOpen source on arxiv.org.
Nature has similarly reported concerns that tens of thousands of recent publications may contain invalid references generated through AI-assisted workflows. [Nature]nature.comHallucinated citations are polluting the scientific literature….Apr 1, 2026 — Tens of thousands of publications from 2025 might…
These findings do not mean that academic literature is fundamentally unreliable. They do indicate, however, that citation verification is becoming a more important part of research quality control.
Checks for papers, authors, journals, and claims
The most effective defence is source tracing rather than citation counting. A reader does not need to verify every reference in a document, but they should verify the references that support important claims.
When encountering a citation:
- Confirm that the paper exists. Search trusted databases such as Crossref, PubMed, Google Scholar, institutional repositories, or the journal’s archive.
- Check the authors and title. Fabricated citations often contain mismatched combinations of real names and fictional titles.
- Verify the journal and publication details. Confirm that the cited article appears in the stated volume, issue, and year.
- Read beyond the abstract. A real paper can still be cited inaccurately.
- Compare the claim with the source. Ask whether the cited work actually supports the statement being made.
- Be cautious with perfect-looking bibliographies. Formatting accuracy is not evidence accuracy.
For AI-assisted research, an additional question is useful: Could this reference have been generated rather than retrieved? If the answer is uncertain, verification becomes essential.
Why source tracing matters more than ever
The rise of AI has not changed the purpose of academic references. Their role remains to provide an inspectable path from claim to evidence. What has changed is the ease with which scholarly-looking references can be produced without any underlying source.
A fabricated citation is more damaging than a simple factual mistake because it disguises the absence of evidence. It invites trust while blocking verification. In an information environment shaped by AI-generated summaries, rapid sharing, and increasingly automated research workflows, the ability to trace a claim back to a real paper, real author, and real finding is becoming one of the most important habits of critical thinking.
Amazon book picks
Further Reading
Books and field guides related to When scholarly looking references are fake. Use these as the next step if you want deeper reading beyond the article.
Calling Bullshit
Directly supports identifying fabricated authority, misleading evidence, and verification failures.
Bad Science
Shows how flawed evidence and misleading references can shape public understanding.
Thinking, Fast and Slow
Explains why readers often trust authoritative-looking citations without verification.
The Demon-Haunted World
Encourages rigorous verification and resistance to unsupported claims.
eBay marketplace picks
Marketplace Samples
Example marketplace items related to this page. Use the search link to explore similar finds on eBay.
Endnotes
-
Source: mental.jmir.org
Link: https://mental.jmir.org/2025/1/e80371Source snippet
Although previous...Read more...
-
Source: pmc.ncbi.nlm.nih.gov
Link: https://pmc.ncbi.nlm.nih.gov/articles/PMC12826005/Source snippet
Fabricated citations in the age of AI: A wake-up call for editors...by H Liu · 2025 · Cited by 2 — Several recent studies have shown...
-
Source: arxiv.org
Link: https://arxiv.org/abs/2605.07723 -
Source: pmc.ncbi.nlm.nih.gov
Link: https://pmc.ncbi.nlm.nih.gov/articles/PMC12658395/Source snippet
by J Linardon · 2025 · Cited by 8 — Fabricated references can mislead readers, distort scientific understanding, and compromise the in...
-
Source: arxiv.org
Link: https://arxiv.org/abs/2603.03299Source snippet
How LLMs Cite and Why It Matters: A Cross-Model Audit of Reference Fabrication in AI-Assisted Academic Writing and Methods to Detect...
-
Source: blogs.library.duke.edu
Title: chatgpt and fake citations
Link: https://blogs.library.duke.edu/blog/2023/03/09/chatgpt-and-fake-citations/Source snippet
These citations may sound legitimate and scholarly, but they are not...Read more...
-
Source: mdpi.com
Link: https://www.mdpi.com/2306-5729/11/5/122 -
Source: nature.com
Link: https://www.nature.com/articles/d41586-026-00969-zSource snippet
Hallucinated citations are polluting the scientific literature....Apr 1, 2026 — Tens of thousands of publications from 2025 might...
-
Source: arxiv.org
Link: https://arxiv.org/pdf/2605.07723Source snippet
LLM hallucinations in the wild: Large-scale evidence from...by Z Zhao · 2026 — We find a sharp rise in non-existent references following...
-
Source: arxiv.org
Link: https://arxiv.org/html/2502.00673v1Source snippet
misinformation and compromise the integrity... (2016) studied the retraction due to fake peer reviews, where publishing journals and aut...
-
Source: arxiv.org
Link: https://arxiv.org/html/2602.05867v1Source snippet
The Case of the Mysterious CitationsDec 16, 2025 — Anecdotal reports from program committees and reviewers increasingly describe a specif...
-
Source: nature.com
Link: https://www.nature.com/articles/s41598-023-41032-5Source snippet
Fabrication and errors in the bibliographic citations...by WH Walters · 2023 · Cited by 537 — Across all 6 studies, 51% of the 732 citat...
-
Source: theverge.com
Link: https://www.theverge.com/news/668315/anthropic-claude-legal-filing-citation-errorSource snippet
The incident occurred in a defense submitted by Anthropic data scientist Olivia Chen on April 30th, as part of a lawsuit brought by music...
-
Source: retractionwatch.com
Link: https://retractionwatch.com/2026/05/07/one-in-277-pubmed-indexed-papers-in-2026-shows-fabricated-references-says-analysis/Source snippet
One in 277 PubMed-indexed papers in 2026 shows...7 days ago — Topaz's group located the sharpest increase in hallucinated references in...
-
Source: tandfonline.com
Link: https://www.tandfonline.com/doi/full/10.1080/08989621.2026.2645390Source snippet
Taylor & Francis OnlineHallucinated citations produced by generative artificial...by DB Resnik · 2026 — A hallucinated citation may supp...
-
Source: thelancet.com
Link: https://www.thelancet.com/journals/lancet/article/PIIS0140-6736%2826%2900603-3/fulltextSource snippet
The LancetFabricated citations: an audit across 2·5 million biomedical...by M Topaz · 2026 · Cited by 6 — In 2023, approximately one in...
-
Source: Wikipedia
Link: https://en.wikipedia.org/wiki/LanguageSource snippet
LanguageLanguage is a structured system of communication that consists of grammar and vocabulary. It is the primary means by which hum...
-
Source: retractionwatch.com
Title: papers that cite retraction watch
Link: https://retractionwatch.com/papers-that-cite-retraction-watch/Source snippet
2025. 'Stamp out paper mills'—science sleuths on how to fight fake research... Misinformation, Conspiracy, and Politicization in Digital...
-
Source: retractionwatch.com
Link: https://retractionwatch.com/2026/03/06/librarian-finds-preposterous-number-of-[fake-referencesSource snippet
Librarian finds 'preposterous number' of fake references in...6 Mar 2026 — Hallucinated references are an area the publisher is “activel...
Additional References
-
Source: researchgate.net
Link: https://www.researchgate.net/publication/388657608_Retracted_Citations_and_Self-citations_in_Retracted_Publications_A_Comparative_Study_of_Plagiarism_and_Fake_Peer_ReviewSource snippet
misinformation and compromise the integrity of scientific... | Find... disinformation and uphold ethical standards in their research pra...
-
Source: linkedin.com
Link: https://www.linkedin.com/posts/keith-king-03a172128_ai-audit-finds-thousands-of-medical-research-activity-7460070359829045248-FEQfSource snippet
Keith King's PostAI Audit Finds Thousands of Medical Research Papers Contain Fabricated Citations A large-scale AI-assisted review of bio...
-
Source: linkedin.com
Link: https://www.linkedin.com/posts/ehud-reiter-331b1747_last-week-i-had-to-deal-with-two-cases-of-activity-7368189984186580993-G0tGSource snippet
LLM-generated papers with fake references: a growing...Last week I had to deal with two cases of papers containing hallucinated referenc...
-
Source: linkedin.com
Link: https://www.linkedin.com/posts/petercorke_the-problem-of-bullshit-i-think-this-is-activity-7408260816644534272-MEMwSource snippet
LLMs Generate Fake Citations in Academic Papers– Research paper has AI-generated list of references. Some of them hallucinations. Nonexis...
-
Source: facebook.com
Link: https://www.facebook.com/groups/reviewer2/posts/10163947762320469/Source snippet
Peer review process fails to catch fake referencesDr-Abdul Waheed, the responsibility lies with whichever copy editor/proofreader sees th...
-
Source: damiencharlotin.com
Link: https://www.damiencharlotin.com/hallucinations/Source snippet
AI Hallucination Cases DatabaseDatabase tracking [legal cases]({{ 'legal-cases/' | relative_url }}) where generative AI produced hallucinated citations submitted in court filings...
-
Source: forbes.com
Title: ai blamed for rise in fabricated citations found in recent research papers
Link: https://www.forbes.com/sites/michaeltnietzel/2026/05/12/ai-blamed-for-rise-in-fabricated-citations-found-in-recent-research-papers/Source snippet
AI Blamed For Rise In Fabricated Citations Found...May 12, 2026 — In 2023, approximately one in 2,828 papers contained at least one fabr...
Published: May 12, 2026
-
Source: cidrap.umn.edu
Title: review uncovers rising rate fake references published biomedical papers
Link: https://www.cidrap.umn.edu/anti-science/review-uncovers-rising-rate-fake-references-published-biomedical-papersSource snippet
uncovers rising rate of fake references in published...May 8, 2026 — Of 97.1 million verified references, 4,046 in 2,810 papers were fab...
Published: May 8, 2026
-
Source: hai.stanford.edu
Title: ai trial legal models hallucinate 1 out 6 or more benchmarking queries
Link: https://hai.stanford.edu/news/ai-trial-legal-models-hallucinate-1-out-6-or-more-benchmarking-queriesSource snippet
on Trial: Legal Models Hallucinate in 1 out of 6 (or More...May 23, 2024 — Our previous study of general-purpose chatbots found that the...
Published: May 23, 2024
-
Source: statnews.com
Title: STATStudy finds explosion of ‘fraudulent’ [AI citations]({{ ‘ai-citations/’ | relative_url }}) in academic
Link: https://www.statnews.com/2026/05/07/lancet-study-finds-steep-rise-fraudulent-citations-academic-papers/Source snippet
Study finds explosion of 'fraudulent' AI citations in academic...May 7, 2026 — In 2023, 1 in 2,828 papers contained one or more fabricat...
Published: May 7, 2026
Topic Tree