Lawyers representing Anthropic recently got busted for using a false attribution generated by Claude in an expert testimony.
But that's one of more than 20 court cases containing AI hallucinations in the past month alone,Down Town according to a new database created by French lawyer and data scientist Damien Charlotin. And those were just the ones that were caught in the act. In 2024, which was the first full year of tracking cases, Charlotin found 36 instances. That jumped up to 48 in 2025, and the year is only half way over. The database, which was created in early May, has 120 entries so far, going back to June 2023.
SEE ALSO: More concise chatbot responses tied to increase in hallucinations, study findsA database of AI hallucinations in court cases shows the increasing prevalence of lawyers using AI to automate the grunt work of building a case. The second oldest entry in the database is the Mata v. Avianca case which made headlines in May, 2023 when law firm Levidow, Levidow & Oberman got caught citing fake cases generated by ChatGPT.
The database tracks instances where an AI chatbot hallucinated text, "typically fake citations, but also other types of arguments," according to the site. That means fake references to previous cases, usually as a way of establishing legal precedent. It doesn't account for the use generative AI in other aspects of legal documents. "The universe of cases with hallucinated content is therefore necessarily wider (and I think much wider)," said Charlotin in an email to Mashable, emphasis original.
"In general, I think it's simply that the legal field is a perfect breeding ground for AI-generated hallucinations: this is a field based on load of text and arguments, where generative AI stands to take a strong position; citations follow patterns, and LLMs love that," said Charlotin.
The widespread availability of generative AI has made it drastically easier to produce text, automating research and writing that could take hours or even days. But in a way, Charlotin said, erroneous or misinterpreted citations for the basis of a legal argument are nothing new. "Copying and pasting citations from past cases, up until the time a citation bears little relation to the original case, has long been a staple of the profession," he said.
The difference, Charlotin noted, is that those copied and pasted citations at least referred to real court decisions. The hallucinations introduced by generative AI refer to court cases that never existed.
Judges and opposing lawyersare always supposed to check citations for their own respective responsibilities in the case. But this now includes looking for AI hallucinations. The increase of hallucinations discovered in cases could be the increasing availability of LLMs, but also "increased awareness of the issue on the part of everyone involved," said Charlotin.
Ultimately, leaning on ChatGPT, Claude, or other chatbots to cite past legal precedents is proving consequential. The penalties for those caught filing documents with AI hallucinations include financial sanctions, formal warnings, and even dismissal of cases.
That said, Charlotin said the penalties have been "mild" so far and the courts have put "the onus on the parties to behave," since the responsibility of checking citations remains the same. "I feel like there is a bit of embarrassment from anyone involved."
Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Topics Artificial Intelligence
Best roborock deal: Save $400 on Q5 Pro+ Robot Vacuum and Mop
Australians will watch a censored version of 'Lady Bird'
Westminster displays world's smallest fidget spinner at Toy Fair 2018
Google launches Google Pay, its answer to Apple Pay
Tennessee vs. UCLA 2025 livestream: How to watch March Madness for free
Twitter updates developer rules in the wake of bot crackdown
Official FCC order overturning net neutrality to be published Thursday
Kind internet strangers helped this dog track down a very special chew toy
Tennessee vs. UCLA 2025 livestream: How to watch March Madness for free
How Danai GuriraOkoye redefines the female warrior in 'Black Panther'
'Thunderbolts*' mid
Joss Whedon "didn’t have a story" for 'Batgirl' — but these women sure do
Kid sends heartwarming letter to teacher after her dog passes away
New York Times ad names every Congressman who's received NRA funding
Whale Vomit Episode 5: Startup Monarchy
Fergie responds to critics of that wildly unpopular national anthem performance
Why Donald Glover got a shout out in the 'Black Panther' credits
Apple will probably launch two new iPads soon
Patched Laptops: Testing Meltdown & Spectre Patches on Ultraportable
Donald Trump thinks he's the first person to come up with movie ratings
A (Secret) History of Pseudonyms by Thessaly La ForceSinger performs 'Bunker Boy,' a catchy tune about Trump's time in the bunkerLa Reine is Splitting for Iowa, Vive La Reine by Lorin SteinPoem: Pomme by Rachel Jamison WebsterA beginner's guide to being a 'brat' in BDSMA (Secret) History of Pseudonyms by Thessaly La ForceChris Adrian on ‘The Great Night’ by Sam MacLaughlinThe Soloist: Jason Moran Live at A Gathering of Tribes by J. D. MitchellA (Secret) History of Pseudonyms by Thessaly La ForceThe Punk Ballerina by Miranda PopkeyImgur to remove explicit images and old contentEven Piers Morgan thinks Rudy Giuliani 'sounds completely barking mad'Staff Picks: John Cassavetes, Giant Marbles, Terry Castle by The Paris ReviewTrudeau takes 20A Week in Culture: Matthew Specktor, Writer and Editor, Part 2 by Matthew SpecktorOliver Broudy on ‘The Saint’ by Rosalind ParryAlexis Ohanian resigns from Reddit to make room for black board memberChris Adrian on ‘The Great Night’ by Sam MacLaughlinThe Paris Review Wins National Magazine Award by Nicole RudickJoe Dunthorne on ‘Submarine’ by Thomas Bunstead Pinterest bans climate misinformation Huawei now has more than 100,000 non How to get a VPN on your iPhone The 10 most exciting reveals from Summer Game Fest 2024 Private astronaut brings Columbia Space Shuttle relic to space station SpaceX increases prices for Starlink service and dish hardware Space events 2022: Meteor showers, NASA's megarocket, metal asteroids and more Save 31% on the Shokz OpenRun Pro at Amazon Xiaomi may release its first flip phone, the MIX Flip, next month · TechNode Tencent to ban digital influencers from livestreaming · TechNode CATL builds first factory in northern China, deepens partnership with BAIC · TechNode Huawei leapfrogs Apple as HarmonyOS surpasses iOS market share in China · TechNode How to use Google's Magic Eraser tool on iPhone. Pete Davidson will blast into space for free on Jeff Bezos' rocket NASA spots dry ice and gullies in a Martian crater See dazzling photos of the Full Pink Moon National Best Friends Day: Get BOGO tickets to see 'Babes' Tencent’s mobile game Dungeon and Fighter earned $100 million in 10 days in May · TechNode Ant Group poured nearly $3 billion into technology research in 2023, including AI · TechNode Bangladesh vs. Nepal 2024 livestream: Watch T20 World Cup for free