Within Hallucinations
When Fake AI Case Law Reaches Court
Fake legal cases show how fluent authority can become costly when professionals skip source verification.
On this page
- Mata v. Avianca as the warning case
- Later sanctions and repeated legal research failures
- Verification duties before AI assisted filings
Page outline Jump by section
Introduction
Legal AI hallucinations became courtroom sanctions because the legal system depends on verifiable authority, not persuasive language. In many professions, a fabricated citation may remain unnoticed. In court, however, every cited case can be checked by opposing counsel and judges. When generative AI systems began inventing judicial decisions, quotations and legal principles that did not exist, those fabrications entered official court records. Once discovered, they were treated not as harmless technical errors but as failures of professional responsibility. The result was a series of sanctions, fines and disciplinary actions that turned legal hallucinations into one of the most visible examples of the risks posed by fluent AI-generated misinformation. [Justia]law.justia.comMata vAvianca, Inc., No. 1:2022cv01461 - Document 54…22 Jun 2023 — A penalty of $5,000 is jointly and severally imposed on Respondents and s…
The significance extends beyond law. Within the broader challenge of critical thinking in the age of social media and AI, legal sanctions demonstrate what happens when confidence is mistaken for accuracy. Courts became an early testing ground because legal practice already contains formal verification duties and documented consequences for getting facts wrong.
Mata v. Avianca as the Warning Case
The turning point was Mata v. Avianca, decided in the United States in 2023. Lawyers representing a plaintiff filed a legal brief containing multiple cases generated by ChatGPT that did not exist. When opposing counsel and the court could not locate the cited authorities, the attorneys were asked to provide copies. Instead of discovering the error immediately, they relied further on the chatbot, which falsely reassured them that the cases were real and available in legal databases. The fabricated authorities were then submitted to the court as supporting documentation. [Justia+2CourtListener]law.justia.comMata vAvianca, Inc., No. 1:2022cv01461 - Document 54…22 Jun 2023 — A penalty of $5,000 is jointly and severally imposed on Respondents and s…
What made the case so influential was not merely the existence of fake citations. Courts have always dealt with mistakes. The alarming feature was that the citations looked authentic. They included plausible case names, quotations and procedural details. The lawyers involved treated the AI output as research rather than as an unverified draft requiring independent confirmation. Association of Corporate Counsel (ACC)+2Virtuosity Legal [acc.com]acc.com8 Aug 2023 — The recent story of two New York attorneys “duped” by ChatGPT into citing “fake” cases in a court submission— and the sancti…
Judge P. Kevin Castel imposed sanctions and a monetary penalty, concluding that the attorneys had abandoned their duty to verify legal authorities before presenting them to the court. The decision rapidly became a cautionary tale throughout the legal profession because it transformed a technical AI failure into a professional conduct issue. [Justia+2CourtListener]law.justia.comMata vAvianca, Inc., No. 1:2022cv01461 - Document 54…22 Jun 2023 — A penalty of $5,000 is jointly and severally imposed on Respondents and s…
The broader lesson was simple: AI may generate legal language, but lawyers remain responsible for every citation bearing their name.
Why Courts Treated Hallucinations as Professional Misconduct
Courts did not sanction lawyers merely for using AI. Judges repeatedly emphasised that technology itself was not prohibited. The problem was submitting unverified information as if it had been independently researched and confirmed. [Association of Corporate Counsel (ACC)]acc.com8 Aug 2023 — The recent story of two New York attorneys “duped” by ChatGPT into citing “fake” cases in a court submission— and the sancti…
Several features of legal practice explain the strong response:
Court filings are representations to the court. Lawyers certify that legal authorities cited in their filings are genuine and relevant. A fabricated case undermines the reliability of the judicial process. [CourtListener]courtlistener.commata v avianca incMata v. Avianca, Inc., 1:22-cv-0146122 Feb 2022 — OPINION AND ORDER ON SANCTIONS: The Court Orders the following sanctions p…
The adversarial system depends on trustworthy citations. Judges and opposing parties rely on cited precedents when making decisions. Fake authorities waste judicial resources and can distort legal outcomes. [EDRM]edrm.netAI Hallucinations in Court: A Wake-Up Call for the Legal…21 Jan 2025 — 2023), in which the court sanctioned an attorney for includ…
Verification is already a professional duty. Legal ethics rules generally require competence, candour and reasonable inquiry before submitting arguments. Courts viewed AI-generated errors as failures of those existing obligations rather than as a completely new category of misconduct. [Association of Corporate Counsel (ACC)+2Reuters]acc.com8 Aug 2023 — The recent story of two New York attorneys “duped” by ChatGPT into citing “fake” cases in a court submission— and the sancti…
Hallucinations are often detectable. Unlike many AI mistakes in everyday life, invented legal cases leave a traceable record. A judge can search a database and discover that a precedent simply does not exist. This visibility makes enforcement easier than in many other professions. [International Tax Journal]internationaltaxjournal.onlineAvianca exposed this risk when attorneys relied on ChatGPT-generated research and submitted fictitious case law, resulting in judicial…
Later Sanctions and Repeated Legal Research Failures
Many observers initially assumed that Mata v. Avianca was an isolated incident caused by unfamiliarity with a new technology. That assumption proved wrong. Courts in multiple jurisdictions continued to encounter AI-generated citations long after the risks became widely known. [Scientific American]scientificamerican.comwhy lawyers keep citing fake cases invented by aihave sanctioned lawyers for filing court documents that include fake AI-generated citations. John Pendygraft/AFP via…Read more…
By 2025 and 2026, judges were increasingly signalling that ignorance was no longer an acceptable explanation. Databases tracking AI-related legal errors documented a growing number of cases involving fabricated authorities, many submitted by practising lawyers rather than self-represented litigants. [Damien Charlotin]damiencharlotin.comDamien CharlotinAI Hallucination CasesThe most comprehensive database of AI hallucination cases in law: legal decisions from courts world…
Recent sanctions illustrate this shift. In 2026, a federal judge in Mississippi sanctioned lawyers on both sides of a dispute after briefs contained fictitious citations generated through AI-assisted research. The court imposed fines, removed counsel from the case and temporarily barred some attorneys from practising before that court. The ruling stressed that AI tools may be used, but lawyers remain accountable for verifying every authority they submit. [Reuters+2Business Insider]reuters.comJudge rules both sides in lawsuit misused AI, disqualifies lawyers A U.SDistrict Judge in Mississippi, Sharion Aycock, has disqualified all attorneys involved in a contract dispute case after discovering both…
A United States appeals court similarly sanctioned lawyers in 2026 after fictitious AI-generated citations appeared in briefs. The court rejected attempts to minimise the problem and highlighted the importance of candour when AI-related mistakes are discovered. [Reuters]reuters.comUS appeals court sanctions lawyers over AI 'hallucinations,' lack of candorappeals court sanctioned two lawyers for submitting court briefs containing fictitious, AI-generated case citations, referred to as "hall…
Outside the United States, courts and regulators have issued increasingly direct warnings. The UK High Court warned lawyers about fabricated case citations appearing in litigation, while Australian courts introduced stricter guidance after repeated incidents involving false authorities and AI-generated content. [The Guardian]theguardian.comThe GuardianHigh court tells UK lawyers to stop misuse of AI after fake…June 6, 2025 — 7 Jun 2025 — High court tells UK lawyers to sto…
The pattern suggests that the issue is no longer viewed as an experimental technology problem. It is increasingly treated as a compliance and governance problem.
Verification Duties Before AI-Assisted Filings
The most important governance lesson from these cases is that AI has not changed the allocation of responsibility. Courts consistently place accountability on the human professional, not on the software. [Reuters]reuters.comJudge rules both sides in lawsuit misused AI, disqualifies lawyers A U.SDistrict Judge in Mississippi, Sharion Aycock, has disqualified all attorneys involved in a contract dispute case after discovering both…
As a result, legal organisations have developed increasingly explicit verification expectations:
- Confirm that every cited case exists in recognised legal databases.
- Check that quotations match the original source.
- Verify that a case supports the proposition for which it is cited.
- Review AI-generated research with the same scrutiny applied to junior staff work.
- Disclose and correct discovered errors promptly rather than defending them. Association of Corporate Counsel (ACC)+2Baker McKenzie [acc.com]acc.com8 Aug 2023 — The recent story of two New York attorneys “duped” by ChatGPT into citing “fake” cases in a court submission— and the sancti…
Regulators and courts have begun formalising these expectations. Proposed and newly adopted rules in some jurisdictions require certifications regarding citation accuracy and explicitly allow sanctions when AI-generated authorities are fabricated. [Reuters]reuters.comUS judiciary asked to adopt rule to curb fake AI-generated cases in filings U.SMagistrate Judge Patty Barksdale has urged the federal judiciary to adopt a nationwide rule requiring litigants to certify the accuracy o…
This development is significant because it reframes AI hallucinations from a technical reliability issue into a governance issue. The central question is no longer whether AI can make mistakes. Courts assume it can. The question is whether professionals have implemented adequate verification before relying on its output.
What These Cases Reveal About Fluent Wrong Answers
Legal AI hallucinations became courtroom sanctions because they exposed a collision between two systems with very different assumptions. Generative AI systems are designed to produce plausible language. Courts are designed to demand demonstrable authority. When those systems met, persuasive but fabricated citations could not survive routine scrutiny. [International Tax Journal]internationaltaxjournal.onlineAvianca exposed this risk when attorneys relied on ChatGPT-generated research and submitted fictitious case law, resulting in judicial…
The legal profession therefore provides an unusually clear example of a broader critical-thinking challenge. A fluent answer can appear complete, authoritative and well sourced while containing information that is entirely invented. In court, the consequences are visible because judges can impose sanctions. Elsewhere, similar errors may pass unnoticed. The lesson from these legal cases is not simply that AI sometimes hallucinates. It is that confidence, formatting and apparent expertise are poor substitutes for verification when decisions carry real-world consequences. Association of Corporate Counsel (ACC)+2Scientific American [acc.com]acc.com8 Aug 2023 — The recent story of two New York attorneys “duped” by ChatGPT into citing “fake” cases in a court submission— and the sancti…
Amazon book picks
Further Reading
Books and field guides related to When Fake AI Case Law Reaches Court. Use these as the next step if you want deeper reading beyond the article.
Artificial Intelligence and Legal Analytics
First published 2017. Subjects: Artificial intelligence, Computers, law and legislation, Law, Methodology, Technological innovations.
The Legal Analyst
First published 2007. Subjects: Law, Psychological aspects of Law, Methodology, Sociological jurisprudence, Psychological aspects.
Thinking Like a Lawyer
First published 2012. Subjects: Law, methodology, Law, Methodology, Juridik, Metodik.
eBay marketplace picks
Marketplace Samples
Example marketplace items related to this page. Use the search link to explore similar finds on eBay.
![Listing image for NCT 127 [FACT CHECK] 5th Album EXHIBIT JUNGWOO Ver/CD+4 Post Card+Card+Sticker](/assets/images/marketplace-covers/56882ab3f02073dbc060.jpg)
Endnotes
-
Source: law.justia.com
Title: Mata v
Link: https://law.justia.com/cases/federal/district-courts/new-york/nysdce/1%3A2022cv01461/575368/54/Source snippet
Avianca, Inc., No. 1:2022cv01461 - Document 54...22 Jun 2023 — A penalty of $5,000 is jointly and severally imposed on Respondents and s...
-
Source: acc.com
Link: https://www.acc.com/resource-library/practical-lessons-attorney-ai-missteps-mata-v-aviancaSource snippet
8 Aug 2023 — The recent story of two New York attorneys “duped” by ChatGPT into citing “fake” cases in a court submission— and the sancti...
-
Source: courtlistener.com
Title: mata v avianca inc
Link: https://www.courtlistener.com/docket/63107798/mata-v-avianca-inc/Source snippet
Mata v. Avianca, Inc., 1:22-cv-0146122 Feb 2022 — OPINION AND ORDER ON SANCTIONS: The Court Orders the following sanctions p...
-
Source: reuters.com
Title: Judge rules both sides in lawsuit misused AI, disqualifies lawyers A U.S
Link: https://www.reuters.com/legal/litigation/judge-rules-both-sides-lawsuit-misused-ai-disqualifies-lawyers-2026-06-09/Source snippet
District Judge in Mississippi, Sharion Aycock, has disqualified all attorneys involved in a contract dispute case after discovering both...
-
Source: reuters.com
Title: US judiciary asked to adopt rule to curb fake AI-generated cases in filings U.S
Link: https://www.reuters.com/legal/government/us-judiciary-asked-adopt-rule-curb-fake-ai-generated-cases-filings-2026-05-29/Source snippet
Magistrate Judge Patty Barksdale has urged the federal judiciary to adopt a nationwide rule requiring litigants to certify the accuracy o...
-
Source: edrm.net
Link: https://edrm.net/2025/01/ai-hallucinations-in-court-a-wake-up-call-for-the-legal-profession/Source snippet
AI Hallucinations in Court: A Wake-Up Call for the Legal...21 Jan 2025 — 2023), in which the court sanctioned an attorney for includ...
-
Source: reuters.com
Title: US appeals court sanctions lawyers over AI ‘hallucinations,’ lack of candor
Link: https://www.reuters.com/legal/litigation/us-appeals-court-sanctions-lawyers-over-ai-hallucinations-lack-candor-2026-06-03/Source snippet
appeals court sanctioned two lawyers for submitting court briefs containing fictitious, AI-generated case citations, referred to as "hall...
-
Source: justia.com
Link: https://www.justia.com/lawyers/florida/orlandoSource snippet
ards, and case results, and schedule a...
-
Source: virtuositylegal.com
Title: ai in court when legal tech goes rogue lessons from mata v avianca
Link: https://virtuositylegal.com/ai-in-court-when-legal-tech-goes-rogue-lessons-from-mata-v-avianca/Source snippet
Virtuosity LegalAI in Court: When Legal Tech Goes Rogue30 Apr 2025 — These fake cases were generated by ChatGPT, an AI-powered language m...
-
Source: internationaltaxjournal.online
Link: https://internationaltaxjournal.online/index.php/itj/article/view/505Source snippet
Avianca exposed this risk when attorneys relied on ChatGPT-generated research and submitted fictitious case law, resulting in judicial...
-
Source: theguardian.com
Link: https://www.theguardian.com/law/2026/apr/16/australia-federal-court-warning-lawyers-ai-artificial-intelligenceSource snippet
In response to a growing number of court filings—at least 73 confirmed cases in Australia—containing fictitious citations and false infor...
-
Source: damiencharlotin.com
Link: https://www.damiencharlotin.com/hallucinations/Source snippet
Damien CharlotinAI Hallucination CasesThe most comprehensive database of AI hallucination cases in law: legal decisions from courts world...
-
Source: scientificamerican.com
Title: why lawyers keep citing fake cases invented by ai
Link: https://www.scientificamerican.com/article/why-lawyers-keep-citing-fake-cases-invented-by-ai/Source snippet
have sanctioned lawyers for filing court documents that include fake AI-generated citations. John Pendygraft/AFP via...Read more...
-
Source: businessinsider.com
Link: https://www.businessinsider.com/increasing-ai-hallucinations-fake-citations-court-records-data-2025-5Source snippet
Data compiled by legal analyst Damien Charlotin reveals 120 such incidents worldwide, with a significant rise in errors traced to legal p...
-
Source: businessinsider.com
Link: https://www.businessinsider.com/mississippi-judge-removes-lawyers-lawsuit-ai-hallucinations-court-filings-2026-6Source snippet
U.S. District Judge Sharion Aycock sanctioned four attorneys involved in a contractual dispute for submitting briefs containing bogus cit...
-
Source: theguardian.com
Link: https://www.theguardian.com/technology/2025/jun/06/high-court-tells-uk-lawyers-to-urgently-stop-misuse-of-ai-in-legal-workSource snippet
The GuardianHigh court tells UK lawyers to stop misuse of AI after fake...June 6, 2025 — 7 Jun 2025 — High court tells UK lawyers to sto...
Published: June 6, 2025
-
Source: btlaw.com
Title: court sanctions attorneys for submitting brief with ai generated false citations
Link: https://btlaw.com/en/insights/alerts/2025/court-sanctions-attorneys-for-submitting-brief-with-ai-generated-false-citationsSource snippet
Baker McKenzieCourt Sanctions Attorneys for Submitting Brief with AI-...Jul 11, 2025 — The attorneys argued that they went through the f...
-
Source: theguardian.com
Link: https://www.theguardian.com/law/2025/sep/03/lawyer-caught-using-ai-generated-false-citations-in-court-case-penalised-in-australian-firstSource snippet
Lawyer caught using AI-generated false citations in court...2 Sept 2025 — Victorian solicitor stripped of his ability to practise as a p...
-
Source: judiciary.hk
Title: list of judge
Link: https://www.judiciary.hk/en/publications/annu_rept_2023r/eng/list_of_judge.htmlSource snippet
s and Judicial Officers20 Nov 2025 — The Hon Chief Justice Andrew CHEUNG, GBM Permanent Judges of the Court of Final Appeal The Hon Mr Ju...
Additional References
-
Source: linkedin.com
Link: https://www.linkedin.com/posts/tim-kowal_appellatelinkedin-activity-7402415789372276736-UpDRSource snippet
AI Cites in Court: Why Courts Impose SanctionsA federal judge is threatening sanctions. The reason? AI-generated legal briefs filled with...
-
Source: pcgamer.com
Link: https://www.pcgamer.com/software/ai/both-lawyers-in-case-use-hallucinating-ai-causing-judge-to-throw-up-hands-bar-them-for-2-years-fine-everybody-and-call-the-whole-thing-off-for-60-days/Source snippet
Attorneys Kathleen M. Wilson and Kathryn Y. Williams used generative AI and did not verify the fictitious legal references it produced. T...
-
Source: law360.com
Link: https://www.law360.com/pulse/ai-trackerSource snippet
Tracking Federal Judge Orders On Artificial IntelligenceConnecticut lawyers and pro se litigants could face case-ending sanctions for cit...
-
Source: lawnext.com
Link: https://www.lawnext.com/2025/05/ai-hallucinations-strike-again-two-more-cases-where-lawyers-face-judicial-wrath-for-fake-citations.htmlSource snippet
AI Hallucinations Strike Again: Two More Cases Where...14 May 2025 — Two more cases have emerged of lawyers submitting briefs containing...
Published: May 2025
-
Source: medium.com
Link: https://medium.com/%40kyle-t-jones/when-ai-goes-wrong-in-court-what-every-lawyer-needs-to-know-about-the-mata-v-avianca-case-ba3575fe328eSource snippet
When AI Goes Wrong in Court: What Every Lawyer Needs...The Mata v. Avianca case changed legal practice. Before June 2023, using AI for l...
Published: June 2023
-
Source: nccourts.gov
Link: https://www.nccourts.gov/Source snippet
The North Carolina Judicial BranchSearch court records, find court dates, and make payments. Search Portal... A public awareness campaig...
-
Source: seyfarth.com
Title: update on the chatgpt case counsel who submitted fake cases are sanctioned
Link: https://www.seyfarth.com/news-insights/update-on-the-chatgpt-case-counsel-who-submitted-fake-cases-are-sanctioned.htmlSource snippet
Update on the ChatGPT Case: Counsel Who Submitted...26 Jun 2023 — On June 8, 2023, the judge in the Mata case held a hearing on the issu...
Published: June 8, 2023
-
Source: esquiresolutions.com
Title: federal court turns up the heat on attorneys using chatgpt for research
Link: https://www.esquiresolutions.com/federal-court-turns-up-the-heat-on-attorneys-using-chatgpt-for-research/Source snippet
Avianca court imposed monetary fines and other remedial measures against the offending attorneys, citing Rule 11 of the Federal...Read more...
-
Source: triallawyersjournal.com
Title: The filing highlights human error and rising judicial scrutiny
Link: https://www.triallawyersjournal.com/articles/law-firm-pushes-back-on-ai-accusations-after-court-flags-faulty-citations/Source snippet
Law Firm Denies AI Use After Court Flags Bad CitationsA federal court questioned faulty legal citations, but defense counsel says AI was...
-
Source: lsj.com.au
Title: lawyer faces sanctions for using bogus citations from chatgpt
Link: https://lsj.com.au/articles/lawyer-faces-sanctions-for-using-bogus-citations-from-chatgpt/Source snippet
Lawyer faces sanctions for using 'bogus' citations from...29 May 2023 — Schwartz was acting for airline passenger Roberto Mata in a negl...
Published: May 2023
Topic Tree