Within Hallucinations
What Fake AI References Do to Research
Fabricated references can pollute scholarly writing, misallocate credit, and make evidence trails harder to trust.
On this page
- How generated references imitate scholarly form
- What citation studies found in AI written text
- Why fake references scale across papers
Page outline Jump by section
Introduction
Hallucinated academic references are among the most damaging forms of AI-generated error because they attack one of research’s core trust mechanisms: the citation. Scholars do not merely cite sources to decorate an argument. References provide an evidence trail that allows readers to verify claims, trace ideas, assess credibility and assign credit. When an AI system invents articles, authors, journal issues or publication details that look genuine, it creates a false appearance of scholarly support. The result is more than a simple mistake. Fake references can mislead readers, waste research time, distort credit allocation and contaminate the scientific record as erroneous citations spread from one paper to another. Studies of AI-generated literature reviews and reference lists have repeatedly found substantial rates of fabricated or inaccurate citations, making reference verification an increasingly important part of critical thinking in the age of AI. [Nature+2JMIR Mental Health]nature.comFabrication and errors in the bibliographic citations…by WH Walters · 2023 · Cited by 529 — This study investigates one particul…
How Generated References Imitate Scholarly Form
Hallucinated references are often difficult to spot because they mimic the structure of legitimate academic citations. Instead of producing obviously nonsensical entries, AI systems frequently combine real author names, plausible article titles, existing journals and realistic publication dates into references that appear authentic at first glance. Researchers examining AI-generated citations have found that many fabricated references are topically relevant and follow standard citation formats even though the underlying publication does not exist. [Nature+2Taylor & Francis Online]nature.comFabrication and errors in the bibliographic citations…by WH Walters · 2023 · Cited by 529 — This study investigates one particul…
This imitation of scholarly form creates a specific credibility problem. Readers are trained to treat citations as signals that evidence exists somewhere beyond the text. When a citation looks correct, many people assume that another scholar, reviewer or editor has already verified it. AI systems exploit that expectation unintentionally. They generate references that satisfy the visual and structural conventions of scholarship without providing the underlying evidence those conventions are meant to represent. [PMC]pmc.ncbi.nlm.nih.govFabricated citations in the age of AI: A wake-up call for editors…by H Liu · 2025 · Cited by 1 — Large language models (LLMs), such…
The danger is amplified because fabricated citations often contain partial truths. A journal may be real while the article is invented. An author may exist while the title is fabricated. A genuine paper may be cited but assigned the wrong findings. These hybrid errors are harder to detect than completely fictional references because they reward superficial checking while defeating deeper verification. [Nature]nature.comFabrication and errors in the bibliographic citations…by WH Walters · 2023 · Cited by 529 — This study investigates one particul…
What Citation Studies Found in AI-Written Text
Empirical research has shown that citation fabrication is not a rare edge case. One widely cited study evaluating GPT-generated references found substantial rates of fabricated bibliographic citations, with many references corresponding to no actual scholarly work. Even when citations referred to real publications, metadata errors remained common. [Nature]nature.comFabrication and errors in the bibliographic citations…by WH Walters · 2023 · Cited by 529 — This study investigates one particul…
More recent studies have reached similar conclusions. Research examining GPT-4o-generated literature reviews in mental health topics reported extensive citation inaccuracies, including fabricated references and bibliographic errors. Overall, a large proportion of generated citations were either wholly invented or contained significant mistakes that would undermine reliable source tracing. [JMIR Mental Health]mental.jmir.orgJMIR Mental HealthInfluence of Topic Familiarity and Prompt Specificity on…by J Linardon · 2025 · Cited by 33 — Objective: This study…
Other analyses focused specifically on scientific writing have found that citation generation remains one of the weakest areas of large language model performance. Reviews of AI-produced academic references consistently report that accuracy rates vary by topic, prompting style and model version, but fabrication remains a recurring problem across systems. [JMIR+2JMIR Medical Education]jmir.orgHallucination Rates and Reference Accuracy of ChatGPT…by M Chelli · 2024 · Cited by 452 — The aim of the study is to assess the pe…
Importantly, these studies reveal that the problem is not limited to students or inexperienced users. Researchers, academics and professionals can all be affected because fabricated citations are often difficult to distinguish from legitimate ones without database searches or full-text verification. [Taylor & Francis Online]tandfonline.comTaylor & Francis OnlineHallucinated Citation Analysis: Delving into Student…by AP Watson · 2024 · Cited by 11 — This article examines…
Why Fake References Damage Research More Than Ordinary Errors
A factual mistake inside a paragraph can often be corrected directly. A fake citation creates a deeper problem because it undermines accountability itself.
When researchers encounter a questionable claim, they normally follow the reference trail to inspect the original evidence. Hallucinated citations break that process. Readers may spend significant time searching for papers that do not exist, attempting to locate inaccessible sources or trying to reconcile contradictory publication details. This diverts effort away from actual research and slows knowledge verification. [PMC]pmc.ncbi.nlm.nih.govby J Linardon · 2025 · Cited by 31 — Fabricated references can mislead readers, distort scientific understanding, and compromise the i…
Fabricated references also distort scholarly credit. Citations influence professional reputation, hiring decisions, grant evaluations and measures of research impact. When AI systems invent sources or misattribute work, they interfere with the mechanisms used to recognise intellectual contributions. Emerging evidence suggests that citation hallucinations may even reinforce existing inequalities by disproportionately assigning apparent authority to already prominent researchers. [arXiv]arxiv.orgLLM hallucinations in the wild: Large-scale evidence from non-existent citationsMay 8, 2026…
Another concern is that citations often function as evidence in themselves. Literature reviews, systematic reviews and policy reports depend heavily on accurate reference lists. If the references are fabricated, then conclusions built upon them may appear supported when no supporting evidence actually exists. Some scholars have argued that hallucinated citations can become a form of research misconduct when references serve as substantive data within an academic argument. [Taylor & Francis Online]tandfonline.comTaylor & Francis OnlineHallucinated citations produced by generative artificial…by DB Resnik · 2026 · Cited by 2 — Hallucinated citati…
Why Fake References Scale Across Papers
The most serious risk is not a single false citation but the possibility of citation pollution.
Research literature operates as a network. Authors cite previous authors, reviewers evaluate reference lists selectively, and later researchers often reuse citations from earlier work. Once a fabricated reference enters that network, it can spread. A later author may assume the citation was checked previously and repeat it without independent verification. Over time, a non-existent source can acquire a misleading appearance of legitimacy simply because it appears in multiple documents. [arXiv]arxiv.orgGhostCite: A Large-Scale Analysis of Citation Validity in the Age of Large Language ModelsFebruary 6, 2026…
Recent large-scale analyses suggest this concern is no longer theoretical. Studies examining millions of references across scientific repositories have identified sharp increases in non-existent citations following widespread adoption of AI writing tools. Researchers estimated that hundreds of thousands of hallucinated citations may have entered scholarly ecosystems in a single year, with many surviving editorial and publication processes. [arXiv+2Nature]arxiv.orgLLM hallucinations in the wild: Large-scale evidence from non-existent citationsMay 8, 2026…
Several high-profile incidents illustrate the scaling problem. Investigations have identified fabricated or misleading citations in academic publications, government reports and major institutional documents. In some cases, false references were discovered only after publication, demonstrating how easily citation errors can pass through existing review systems. [The Times+2The Washington Post]thetimes.comThe Times Publisher under fire after 'fake' citations found in AI ethics guideThe book, marketed as an authoritative exploration of AI ethics, is under scrutiny after investigations revealed that several chapters us…
What This Means for Critical Thinking
The rise of hallucinated references changes what it means to evaluate evidence. Traditionally, readers could often treat a properly formatted citation as a reasonable indication that a source existed. Increasingly, that assumption is unsafe.
Critical thinking now requires distinguishing between the appearance of documentation and actual documentation. A citation should be treated as the beginning of verification, not the end of it. Researchers, students and readers must increasingly ask practical questions: Does the paper exist? Does the citation lead to the claimed source? Does the source support the argument being made? Is the publication information accurate?
The broader lesson is that fluent presentation and scholarly formatting are not substitutes for evidence. AI systems can reproduce the outward signals of academic credibility with remarkable accuracy while failing to provide the underlying foundation that gives those signals meaning. In research, the most damaging hallucinations are often not the obviously absurd ones. They are the references that look real enough to stop people checking. [Nature+2Taylor & Francis Online]nature.comFabrication and errors in the bibliographic citations…by WH Walters · 2023 · Cited by 529 — This study investigates one particul…
Amazon book picks
Further Reading
Books and field guides related to What Fake AI References Do to Research. Use these as the next step if you want deeper reading beyond the article.
The Craft of Research (Chicago Guides to Writing, Editing, an...
First published 1995. Subjects: Technical writing, Methodology, Research, Recherche, Guides, manuels.
eBay marketplace picks
Marketplace Samples
Example marketplace items related to this page. Use the search link to explore similar finds on eBay.
Endnotes
-
Source: nature.com
Link: https://www.nature.com/articles/s41598-023-41032-5Source snippet
Fabrication and errors in the bibliographic citations...by WH Walters · 2023 · Cited by 529 — This study investigates one particul...
-
Source: mental.jmir.org
Link: https://mental.jmir.org/2025/1/e80371Source snippet
JMIR Mental HealthInfluence of Topic Familiarity and Prompt Specificity on...by J Linardon · 2025 · Cited by 33 — Objective: This study...
-
Source: jmir.org
Link: https://www.jmir.org/2024/1/e53164/Source snippet
Hallucination Rates and Reference Accuracy of ChatGPT...by M Chelli · 2024 · Cited by 452 — The aim of the study is to assess the pe...
-
Source: pmc.ncbi.nlm.nih.gov
Link: https://pmc.ncbi.nlm.nih.gov/articles/PMC12826005/Source snippet
Fabricated citations in the age of AI: A wake-up call for editors...by H Liu · 2025 · Cited by 1 — Large language models (LLMs), such...
-
Source: mededu.jmir.org
Link: https://mededu.jmir.org/2025/1/e72998/Source snippet
Citation... Citations and References in Scholarly Writing: Cross-Disciplinary Study.Read more...
-
Source: arxiv.org
Link: https://arxiv.org/abs/2603.03299Source snippet
How LLMs Cite and Why It Matters: A Cross-Model Audit of...by MZ Naser · 2026 — Abstract:Large language models (LLMs) have been noted to...
-
Source: pmc.ncbi.nlm.nih.gov
Link: https://pmc.ncbi.nlm.nih.gov/articles/PMC12658395/Source snippet
by J Linardon · 2025 · Cited by 31 — Fabricated references can mislead readers, distort scientific understanding, and compromise the i...
-
Source: arxiv.org
Link: https://arxiv.org/abs/2605.07723Source snippet
LLM hallucinations in the wild: Large-scale evidence from non-existent citationsMay 8, 2026...
Published: May 8, 2026
-
Source: arxiv.org
Link: https://arxiv.org/abs/2602.06718Source snippet
GhostCite: A Large-Scale Analysis of Citation Validity in the Age of Large Language ModelsFebruary 6, 2026...
Published: February 6, 2026
-
Source: nature.com
Link: https://www.nature.com/articles/d41586-026-00969-zSource snippet
Hallucinated citations are polluting the scientific literature....3 days ago — Tens of thousands of publications from 2025 might include...
-
Source: arxiv.org
Link: https://arxiv.org/html/2602.05867v1Source snippet
The Case of the Mysterious Citations16 Dec 2025 — It is not possible to prove that a citation error was generated through an LLM hallucin...
-
Source: tandfonline.com
Link: https://www.tandfonline.com/doi/abs/10.1080/0361526X.2024.2433640Source snippet
Taylor & Francis OnlineHallucinated Citation Analysis: Delving into Student...by AP Watson · 2024 · Cited by 11 — This article examines...
-
Source: tandfonline.com
Link: https://www.tandfonline.com/doi/full/10.1080/08989621.2026.2645390Source snippet
Taylor & Francis OnlineHallucinated citations produced by generative artificial...by DB Resnik · 2026 · Cited by 2 — Hallucinated citati...
-
Source: timesofindia.indiatimes.com
Link: https://timesofindia.indiatimes.com/india/1-5-lakh-fake-[ai-citationsSource snippet
This influx primarily occurred as AI-generated references from preprint papers made their way into peer-reviewed journals. The study high...
-
Source: thetimes.com
Title: The Times Publisher under fire after ‘fake’ citations found in AI ethics guide
Link: https://www.thetimes.com/uk/science/article/ai-ethics-guide-citations-nsnjmz25bSource snippet
The book, marketed as an authoritative exploration of AI ethics, is under scrutiny after investigations revealed that several chapters us...
-
Source: washingtonpost.com
Link: https://www.washingtonpost.com/health/2025/05/29/maha-rfk-jr-ai-garble/Source snippet
An analysis revealed over 37 repeated citations among the 522 references and several nonexistent or inaccurate studies. Markers such as "...
-
Source: pubmed.ncbi.nlm.nih.gov
Link: https://pubmed.ncbi.nlm.nih.gov/41223407/Source snippet
of Topic Familiarity and Prompt Specificity on...by J Linardon · 2025 · Cited by 14 — Objective: This study aims to examine the frequenc...
-
Source: pmc.ncbi.nlm.nih.gov
Link: https://pmc.ncbi.nlm.nih.gov/articles/PMC12331776/Source snippet
Accuracy and limitations...by G Erol · 2025 · Cited by 29 — This study evaluates the reliability and accuracy of AI-generated text detec...
-
Source: pmc.ncbi.nlm.nih.gov
Link: https://pmc.ncbi.nlm.nih.gov/articles/PMC10439949/Source snippet
nih.govChatGPT: these are not hallucinations – they're fabrications...by R Emsley · 2023 · Cited by 337 — One study investigating the fr...
-
Source: pmc.ncbi.nlm.nih.gov
Link: https://pmc.ncbi.nlm.nih.gov/articles/PMC12107892/Source snippet
authorship: an explorative case study around an AI...by D Spinellis · 2025 · Cited by 25 — The findings highlight the risks posed by AI...
Additional References
-
Source: facebook.com
Link: https://www.facebook.com/groups/reviewer2/posts/10162032476255469/Source snippet
AI-Generated References and Academic IntegrityI think I just discovered a scam or something. I was writing a draft and checking reference...
-
Source: reddit.com
Link: https://www.reddit.com/r/OpenAI/comments/105pib0/chatgpt_gives_me_references_i_cant_find_back/Source snippet
ChatGPT gives me references I can't find back: r/OpenAIChat GPT does not give real references. They have properly formatted hallucinatio...
-
Source: techradar.com
Link: https://www.techradar.com/pro/a-major-kpmg-report-on-ai-was-found-to-be-chock-full-of-ai-hallucinationsSource snippet
The report contained 45 citations, with only five found to be accurate; the rest were either fabricated, distorted, or misleading. GPTZer...
-
Source: hps.cam.ac.uk
Link: https://www.hps.cam.ac.uk/students/academic-misconductSource snippet
misconduct: plagiarism and use of AIHPS considers the submission of falsified information (such as fake references, quotes or grossly mis...
-
Source: techradar.com
Link: https://www.techradar.com/ai-platforms-assistants/5-signs-that-chatgpt-is-hallucinatingSource snippet
These hallucinations stem from how AI is trained: by predicting text sequences without verifying facts. 1. **Strange specificity without...
-
Source: ox.ac.uk
Link: https://www.ox.ac.uk/news/2023-11-20-large-language-models-pose-risk-science-false-answers-says-oxford-studySource snippet
Large Language Models pose risk to science with false...20 Nov 2023 — It explains, 'LLMs are designed to produce helpful and convincing...
-
Source: cidrap.umn.edu
Link: https://www.cidrap.umn.edu/anti-science/review-uncovers-rising-rate-fake-references-published-biomedical-papersSource snippet
misconduct, or uncritical use of artificial intelligence (AI) writing tools.... Fake references hard to spot. The authors noted that the...
-
Source: facebook.com
Link: https://www.facebook.com/cnet/posts/a-new-study-finds-that-ai-hallucinations-produced-nearly-150000-fake-citations-a/1367978978525291/Source snippet
A new study finds that AI hallucinations produced nearly...A new study finds that AI hallucinations produced nearly 150000 fake citation...
-
Source: retractionwatch.com
Title: fake references chatgpt journal academic ethics springer nature whistleblowing
Link: https://retractionwatch.com/2025/12/02/fake-references-chatgpt-journal-academic-ethics-springer-nature-whistleblowing/Source snippet
The case of the fake references in an ethics journalDec 2, 2025 — Many would-be whistleblowers write to us about papers with nonexistent...
-
Source: researchgate.net
Title: 377846480 Large language models and academic writing Five tiers of engagement
Link: https://www.researchgate.net/publication/377846480_Large_language_models_and_academic_writing_Five_tiers_of_engagementSource snippet
Large language models and academic writing: Five tiers of...Mar 15, 2026 — This discussion breaks LLM usage into tiers of use, offering...
Topic Tree