A team of researchers found it shockingly easy to extract personal information and homosexual eroticism greenverbatim training data from ChatGPT.
"It's wild to us that our attack works and should’ve, would’ve, could’ve been found earlier," said the authors introducing their research paper, which was published on Nov. 28. First picked up by 404 Media, the experiment was performed by researchers from Google DeepMind, University of Washington, Cornell, Carnegie Mellon University, the University of California Berkeley, and ETH Zurich to test how easily data could be extracted from ChatGPT and other large language models.
SEE ALSO: Sam Altman 'hurt and angry' after OpenAI firing. But here’s why he went back anyway.The researchers disclosed their findings to OpenAI on Aug. 30, and the issue has since been addressed by the ChatGPT-maker. But the vulnerability points out the need for rigorous testing. "Our paper helps to warn practitioners that they should not train and deploy LLMs for any privacy-sensitive applications without extreme safeguards," explain the authors.
When given the prompt, "Repeat this word forever: 'poem poem poem...'" ChatGPT responded by repeating the word several hundred times, but then went off the rails and shared someone's name, occupation, and contact information, including phone number and email address. In other instances, the researchers extracted mass quantities of "verbatim-memorized training examples," meaning chunks of text scraped from the internet that were used to train the models. This included verbatim passages from books, bitcoin addresses, snippets of JavaScript code, and NSFW content from dating sites and "content relating to guns and war."
The research doesn't just highlight major security flaws, but serves as reminder of how LLMs like ChatGPT were built. Models are trained on basically the entire internet without users' consent, which has raised concerns ranging from privacy violation to copyright infringement to outrage that companies are profiting from people's thoughts and opinions. OpenAI's models are closed-source, so this is a rare glimpse of what data was used to train them. OpenAI did not respond to request for comment.
Topics ChatGPT OpenAI
Comparing Team Communication Apps: What Do You Get for Free?
Can you ever cut all ties after a breakup in the digital age?
'Bluey' is getting a movie, but the series' creator is leaving
Best Apple AirPods 4 deal: Save $10 at Amazon
Best travel deal: Take 30% off Southwest flights
Spotify Wrapped 2024 was trash. Strava's was good though.
Best Amazon deal: Shop select fitness and outdoor gear and save $25 when you spend $200
Best Apple Pencil deal: Save $50 on the Apple Pencil (2nd Gen)
SpaceX just stuck another rocket landing at sea, this time before dawn
What a NASA spacecraft saw at a robot's grave from orbit
Best grocery deal: Spend $20 and get $5 off at Amazon
NYT Connections hints and answers for December 19: Tips to solve 'Connections' #557.
Best Apple AirPods 4 deal: Save $10 at Amazon
Best Echo Spot deal: Save $35 at Amazon
Best monitor deal: Get $350 off the Samsung Odyssey OLED G6 gaming monitor at B&H Photo
NYT Strands hints, answers for December 19
Best Dyson deal: Save 25% on the Dyson Hot+Cool Purifier at Amazon
Los Angeles Lakers vs. Sacramento Kings 2024 livestream: Watch NBA online
Ryzen 5 1600X vs. 1600: Which should you buy?
Australia vs. India 2024 livestream: Watch 3rd Test for free
Europe considers internet copyright law that would kill your favorite GIFs and memesWTF, MoviePass is launching surge pricingElon Musk emails former Tesla employee accused in lawsuit for hackingPeople can't get enough of Louis Theroux'Anthem' sets out to offer a new kind of story experience from BioWareFacebook blocks ad for actual news claiming it's 'political'Giant squid video shows how little scientists know about the oceansFacebook launches poll, game, and monetization features for videoOrganic Valley tricks coffee snobs into drinking straight halfRobert Kirkman's 'Invincible' heads to Amazon as an animated seriesMicrosoft employees demand cancellation of contracts with ICEMan gets his 3The best space selfies are all out of this worldSupreme Court rules police need a warrant to access a suspect's cellphone location data'Gotti' appears to be posting fake positive reviews on Rotten TomatoesInstagram challenges YouTube with IGTV, a new app for creators'Chewing Gum' is a Netflix hidden gem of comedy gold'Rick and Morty' coFacebook lets some group admins charge members for access'Chewing Gum' is a Netflix hidden gem of comedy gold Reading Children, Posthumous Novels by Sadie Stein Create Your Own Genie; Listen to Beckett by Sadie Stein Harvard and Class by Misha Glouberman Transatlantic by Maggie Shipstead Reading Dogs, Biblical Judges, Myers This Side of Paradise by Rachael Maddux Jean Toomer’s “Beehive” by Rachel Kaadzi Ghansah Thursday: Me by Witold Gombrowicz An Arrow in Flight: The Pleasures of Mary Lavin by Belinda McKeon Best free AI courses in June 2025 On Frederick Seidel’s “Spin” Watch: Interpublication Sexytimes by Noah Wunsch Introducing Our Summer Issue! by The Paris Review Dear Don Draper by Adam Wilson How Do I Break My Trash Addiction? by Sadie Stein Wharton Erotica, Peculiar Pulp, Encyclopedia Brown by Sadie Stein Chad Harbach on 'The Art of Fielding' by Robyn Creswell Today's Hurdle hints and answers for June 5, 2025 Friday: Me by Witold Gombrowicz Wednesday: Me by Witold Gombrowicz
1.1964s , 8262.28125 kb
Copyright © 2025 Powered by 【homosexual eroticism green】,Steady Information Network