In a refrain that feels almost entirely too familiar by now: Generative AI is Jelena Jensen Archivesrepeating the biases of its makers.
A new investigation from Bloombergfound that OpenAI's generative AI technology, specifically GPT 3.5, displayed preferences for certain racial in questions about hiring. The implication is that recruiting and human resources professionals who are increasingly incorporating generative AI based tools in their automatic hiring workflows — like LinkedIn's new Gen AI assistant for example — may be promulgating racism. Again, sounds familiar.
The publication used a common and fairly simple experiment of feeding fictitious names and resumes into AI recruiting softwares to see just how quickly the system displayed racial bias. Studies like these have been used for years to spot both human and algorithmic bias among professionals and recruiters.
"Reporters used voter and census data to derive names that are demographically distinct — meaning they are associated with Americans of a particular race or ethnicity at least 90 percent of the time — and randomly assigned them to equally-qualified resumes," the investigation explains. "When asked to rank those resumes 1,000 times, GPT 3.5 — the most broadly-used version of the model — favored names from some demographics more often than others, to an extent that would fail benchmarks used to assess job discrimination against protected groups."
The experiment categorized names into four categories (White, Hispanic, Black, and Asian) and two gender categories (male and female), and submitted them for four different job openings. ChatGPT consistently placed "female names" into roles historically aligned with higher numbers of women employees, such as HR roles, and chose Black women candidates 36 performance less frequently for technical roles like software engineer.
ChatGPT also organized equally ranked resumes unequally across the jobs, skewing rankings depending on gender and race. In a statement to Bloomberg, OpenAI said this doesn't reflect how most clients incorporate their software in practice, noting that many businesses fine tune responses to mitigate bias. Bloomberg's investigation also consulted 33 AI researchers, recruiters, computer scientists, lawyers, and other experts to provide context for the results.
The report isn't revolutionary among the years of work by advocates and researchers who warn against the ethical debt of AI reliance, but it's a powerful reminder of the dangers of widespread generative AI adoption without due attention. As just a few major players dominate the market, and thus the software and data building our smart assistants and algorithms, the pathways for diversity narrow. As Mashable's Cecily Mauran reported in an examination of the internet's AI monolith, incestuous AI development (or building models that are no longer trained on human input but other AI models) leads to a decline in quality, reliability, and, most importantly, diversity.
And, as watchdogs like AI Nowargue, "humans in the loop" might not be able to help.
Topics Artificial Intelligence Social Good ChatGPT
Bomb Envy
Elon Musk's Boring Company won't build a West LA test tunnel anymore
'Miles' the dibbler is cute, but he also marks a major breeding milestone
What we learned from George R. R. Martin's new book 'Fire and Blood'
The Anatomy of Liberal Melancholy
Hidden rainbow hair makes a bold trend safe for any office
First Indigenous female MP sworn in amid traditional song
Surprise! Apple Music is coming to the Amazon Echo
NYT Connections Sports Edition hints and answers for May 18: Tips to solve Connections #237
PDF fail reveals Facebook considered selling access to data
Best Max streaming deal: Save 20% on annual subscriptions
Refusal to remove cowboy hat is totally worth the suspension
'Fallout 76' is one purchase mistake we could have avoided
Steph Curry responds to 9
Best Apple deal: Save $19 on AirTag 4
Solange Knowles wraps herself in yarn, still inspires outfit envy
Praise be! Margaret Atwood is finally writing a sequel to 'The Handmaid's Tale'
Jon Stewart interviewing Stephen Colbert is just as much fun as you're hoping
Best robot vacuum deal: Get the Roborock Q5 Max for 53% off at Amazon
Marriott data breach affects 500 million Starwood customers
California's Apple Fire spawns towering smoky cloudsIndian PM Narendra Modi greets Donald Trump with a bear hugTwitter may have to pay hundreds of millions in fines for privacy screwHarry Potter movies shift to Peacock as streaming wars heat upFacebook tells employees they can work from home until July 2021Easy cocktail recipes for people who aren't ready to go to bars just yetSurvey reveals who's winning the delivery app wars: DoorDash, Uber Eats, or GrubhubDonald Trump is going after Jeff Bezos but also seems a bit confusedMicrosoft confirms it's in talks to buy TikTok, and Trump is involvedA disgusted mom posted a very creepy baby onesie and the internet is not into itKFC employee is the spitting image of Korean movie star and people are going crazy over himTSA agent finds 20Apple's $699 Mac Pro wheels too pricey? These are much cheaper.Google's 'Safe Folder' lets users set a PIN code to keep files away from prying eyesCalifornia's Apple Fire spawns towering smoky cloudsFacebook made a major announcement and accidentally made a sex jokeHow the U.S. can defend its elections from cyberattacksTwitter forces DNC, journalists to delete criticism of Trump’s coronavirus misinformationKFC employee is the spitting image of Korean movie star and people are going crazy over himUpdate: Twitter temporarily bans Trump team from tweeting You can now buy a 40 of rosé because we've reached peak rosé Facebook is turning into a confusing social nightmare The next iPhone will be less expensive than we thought, analysts say MashReads Podcast: 'Goodbye Days' dives into the messy feelings of young grief Legendary insult comic Don Rickles dies at 90 'Marvel Heroes' fans are NOT happy about this 'Omega' console release Do we need another wireless carrier? Who cares! Comcast is here anyways. Police drones will watch over runners at this year's Boston Marathon There's now an animated poop Whoa, Microsoft just squeezed by Apple in tablet satisfaction Man drives his car into the middle of a river because his GPS said to Shared bikes are so popular, they've squeezed humans out of this park The DIY space race is here, and it's awesome The coder who built Mastodon is 24, fiercely independent, and doesn’t care about money Twitter to developers: Please love us again... please? Citizen phone numbers leaked on Twitter by cops in Bangalore Microsoft Surface Pro 5 might not be the big upgrade you're expecting Road rage in Australia? It's basically a bunch of indecipherable squawking Finally, a 'silent taxi' service for people who hate making painful small talk Fans of a TV show discovered 4 planets in only 48 hours
2.4059s , 8223.9765625 kb
Copyright © 2025 Powered by 【Jelena Jensen Archives】,Steady Information Network