Meta's Llama model has memorized Harry Potter and free erotic moviesthe Sorcerer's Stoneso well that it can reproduce verbatim excerpts from 42 percent of the book, according to a new study.
Researchers from Stanford, Cornell, and West Virginia University analyzed dozens of books from the now-infamous Books3 dataset, a collection of pirated books used to train Meta's Llama models. Books3 is also at the center of a copyright infringement lawsuit against Meta,Kadrey v. Meta Platforms, Inc.The study's authors say their findings could have major implications for AI companies facing similar lawsuits.
According to the research paper, the Llama 3.1 model "memorizes some books, like Harry Potterand 1984, almost entirely." Specifically, the study found that Llama 3.1 has memorized 42 percent of the first Harry Potter book so well that it can reproduce verbatim excerpts at least 50 percent of the time. Overall, Llama 3.1 could reproduce excerpts from 91 percent of the book, though not as consistently.
"The extent of verbatim memorization of books from the Books3 dataset is more significant than previously described," said the paper. But the researchers also discovered that "memorization varies widely from model to model and from book to book within each model, as well as varying in different parts of individual books." For example, the study estimated that Llama 3.1 only memorized 0.13 percent of Sandman Slimby Richard Kadrey, one of the lead plaintiffs in the class action copyright suit against Meta.
So, while some of the paper's findings seem damning, don't call it a smoking gun for plaintiffs in AI copyright infringement cases.
"These results give everyone in the AI copyright debate something to latch on to," wrote journalist Timothy B. Lee in his Understanding AI newsletter. "Divergent results like these could cast doubt on whether it makes sense to lump J.K. Rowling, Richard Kadrey, and thousands of other authors together in a single mass lawsuit. And that could work in Meta’s favor, since most authors lack the resources to file individual lawsuits."
Why is Llama able to reproduce some books more than others? "I suspect that the difference is because Harry Potter is a much more famous book. It's widely quoted and I'm sure that substantial excerpts from it on third-party websites found their way into the training data on the web," said James Grimmelmann, a professor of digital and information law at Cornell University, who was cited in the paper.
What this also shows, Grimmelmann said, is that "AI companies can make choices that increase or reduce memorization. It's not an inevitable feature of AI; they have control over it."
Meta and other AI companies have argued that using copyrighted works to train their models is protected under fair use, a complex legal doctrine. However, the extent of memorization could complicate those arguments.
“Yes, I do think that the likelihood that LLMs are memorizing more than previously thought changes the copyright analysis,” Robert Brauneis, a professor with the George Washington University Law School, said in an email to Mashable. He concluded that the study’s findings could ultimately weaken Meta’s fair use argument.
We asked Meta for comment on the study's findings, and we'll update this article if we receive a response.
Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Topics Artificial Intelligence Meta
Philips now allows customers to 3D print replacement parts
'Fake news' jokes dominate after Oscars best picture flub
Netflix and Amazon finally win Oscars
This giraffe birth livestream is driving the internet insane
Stablecoin bill advances in U.S. Senate as Trump critics call to end his crypto dealings
Gary from Chicago deserves a lifetime achievement Oscar
India's prime minister wants everyone to tell their friends about this app
All the best and worst looks on the Oscars 2017 red carpet
SpaceX's Starlink will provide free satellite internet to families in Texas school district
Oscars shocker: 'La La Land' announced as Best Picture, but 'Moonlight' wins
'The Last of Us' Season 2, episode 3's opening credits has a heartbreaking change
People want to #DeleteUber after its last tweet in the Philippines
This giraffe birth livestream is driving the internet insane
Fujifilm under fire for sexist camera demo featuring topless female model
Best Sony deal: Save $100 on WH
Stop throwing coins into ponds, this sea turtle ate a whole bunch and needs surgery
The best and worst moments of the craziest Oscars ever
Oscars 2017: Full winners list
Get Rid of Windows 10 Ads, Office Offers and Other Annoyances
Fujifilm under fire for sexist camera demo featuring topless female model
The Royal Family has a cautionary message for the worldTim Cook says India is 'a great place to be' as Apple posts its allTwitter tweaks video again, adding view counts for some usersEvery day, this dog picks up where the newspaper delivery person left offUber, Ola ordered to halt rideSiri now predicts the winner of Super Bowl LIReaction GIF Generator turns your selfies into hilarious GIFsVeteran speaks out against 'Muslim ban' with incredible Iraq storyHeroic police dog leaves a pawThis country wants to pay people to use the looTim Cook says India is 'a great place to be' as Apple posts its allPhones will start matching your fingerprint on both device and SIM cardReaction GIF Generator turns your selfies into hilarious GIFs'Conan Exiles' lets you adjust the size of your physical... assetsIs it legal for authorities to check your social media at the U.S. border?Canada comes for Fox News over its false Quebec mosque tweetNew campaign wants you to raise funds for abuse victims by ditching the razorEven primates use Tinder nowNo, Twitter shouldn't ban Trump—here's whyTeenager receives a huge gift surprise from Miss Universe contestant Six Photos from W. G. Sebald’s Albums by Nick Warr 7 songs poised to make a Swift exit from TikTok amid UMG's licensing dispute A man with a nasty habit of suing the EPA now leads it, because why not? Beginning with Color: An Interview with Etel Adnan by Laure Adler Lost and Found by Sophie Haigney Child Reading by Timmy Straw 'Shortcomings' review: Messy, rock The Paris Review’s Favorite Books of 2023 by The Paris Review Review: 'Orion and the Dark' is here to soothe your anxiety A Pimp with a Heart of Gold by Liam Sherwin Apple's Vision Pro will launch with 600 new apps On Sven Holm’s Novella of Nuclear Disaster by Jeff VanderMeer Dirty Brown Subaru Outback by Kelan Nee The Displaced Person: A Syllabus by Robert Glück The Future of Ghosts by Jeanette Winterson YouTuber creates 20 Tim Cook says big Apple AI announcement is coming later this year How to have car sex Wordle today: The answer and hints for February 1 SpaceX aborts rocket launch seconds before liftoff, but may still fly Sunday
2.2995s , 8224.8359375 kb
Copyright © 2025 Powered by 【free erotic movies】,Steady Information Network