【Esther Moser】

Facebook doesn't just want its AI-trained bots to know how humans speak--it wants them to understand our faces,Esther Moser too.

In a newly published paper, the company's AI researchers detail their efforts to train a bot to mimic human facial expressions during a conversation.

SEE ALSO: Let's all take a deep breath and stop freaking out about Facebook's bots 'inventing' a new language

The researchers trained the bots using a series of YouTube videos of people having Skype conversations where each participant's face was clearly visible. They then used these videos as training data for their AI system.

Notably, the researchers didn't teach the bot to recognize a particular type of expression, or the emotions associated with them, like "happy" or "sad." Instead, they trained the system to recognize subtle patterns in users' faces. These patterns, sometimes referred to as "micro expressions," tend to be similar in everyone, even though our faces may look very different.

The image below shows the type of patterns the system learned to recognize.

Mashable Light Speed Want more out-of-this world tech, space and science stories? Sign up for Mashable's weekly Light Speed newsletter. By clicking Sign Me Up, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy. Thanks for signing up!

Original image has been replaced. Credit: Mashable

By learning these patterns, the system was able to predict which expressions looked more human-like. The researchers tested out their bot's newfound abilities using human judges who were asked whether they believed the bot's animated expressions were believable.

The researchers don't delve into specific practical applications for their method, though they note that human-bot interactions are most effective when people are engaged with the "agent" (research speak for robot) they are interacting with.

Now, Facebook isn't making a humanoid robot -- that we know about at least -- but it's not difficult to imagine this type of research impacting other areas Facebook hasinvested in, like virtual reality, though the researchers don't address this particular use case.

The company has made big investments in social applications for virtual reality, including one called Facebook Spaces, which allows participants to interact with each other's avatars in a virtual environment. Their latest research could perhaps one day have implications on Facebook's efforts to improve avatars in VR.

The research is still in its early days for now, but the scientists say they hope their work will inspire more groups to look at similar situations. You can read their full paper here.

---

Featured Video For You

---

An army of robots planned, designed, and built this 3-story house from the ground up

---

Topics Artificial Intelligence Facebook Social Media

• Deals
• Social Good
• Shopping
• Games
• Life
• Science
• Entertainment
• Digital Culture

• New MIT report reveals energy costs of AI tools like ChatGPT
• NASA spots explosion of X
• Redditor claims MacBook Pro exploded during 'normal use'
• Female journalist has defiant response to troll publishing nude photos of her
• Gods of War
• Apple fans lose their sh*t for an Apple Watch tip calculator
• Oh hell yeah, look how big this turtle is
• Crisis counselors were on set for 'When They See Us' cast and crew
• New MIT report reveals energy costs of AI tools like ChatGPT
• Time names Trump person of the year and Twitter has a lot to say

• A whole country is tracking a minister's flight back to the UK to maybe get fired
• This 'Harry Potter' sock advent calendar could free 24 house elves this Christmas
• A chill baby inspired an equally chill Photoshop battle
• Facebook's Oversight Board now allows users to appeal to have content removed
• Papa John's responds to white nationalist support of its pizza chain
• DIYers, save up to 20% on spring essentials at The Home Depot
• Disney, pressured by a critics boycott, ends the LA Times blacklisting
• Instagram will let some users choose whether they want to see like counts
• How to shut down Spot the robot 'dog,' should you ever need to
• Lebron James gives a cryptic explanation behind his probably petty Instagram posts

• Best robot vacuum deal: Get the Roborock Q5 Max for 53% off at Amazon
• Apple just made it way easier to delete Facebook
• Disney Star Wars park is late
• Apple fans lose their sh*t for an Apple Watch tip calculator
• I'm a college professor. My advice to young people who feel hooked on tech
• Oppo has a phone with a selfie camera hidden under the display
• 6 things to know about Disneyland's new Star Wars park: Preview
• Google Cloud outage breaks Snapchat, YouTube, Gmail, and more
• Hurricane Laura's impact lingered with nightmarish mosquito swarms
• Amazon’s grocery store disruption has a very human problem

• Today's Hurdle hints and answers for May 9, 2025
• What's the deal with Yolo, the #1 app that's taken over Snapchat?
• The weirdest insults politicians threw at each other in government this year
• Samsung Notebook 7 is essentially a MacBook Pro with more ports
• Keeping Hope Alive
• Apple isn't acting subtle about the looming death of iTunes
• Meizu 16Xs will make you question $1,000 flagships
• New Google Play policies aim to fix loot boxes, curb sex and hate
• How to Settle Down with Dystopia
• Disney Star Wars park is late