Everyone knows sound is Watch Dark Fantasies (2010)a critical component to most films and videos. After all, even when films were silent, there was still a musical accompanist letting the audience know how to feel.
This natural law remains the same for the new crop of generative AI videos, which emerge eerily silent. That's part of why Google has been working on "video-to-audio" technology (V2A) which "makes synchronized audiovisual generation possible." On Monday, Google's AI lab, DeepMind, shared progress on generating such audio including soundtracks and dialogue that automatically match up with AI-generated videos.
Google has been hard at work developing multimodal generative AI technology to compete with rivals. OpenAI has its AI video generator Sora (yet to be publicly released) and GPT-4o, which creates AI voice responses. Companies like Meta and Suno have been exploring AI-generated audio and music, but pairing audio with video is relatively new. ElevenLabs has a similar tool that matches audio to text prompts, but DeepMind says V2A is different because it doesn't require text prompts.
V2A can be paired with AI video tools like Google Veo or existing archival footage and silent films. This can be used for soundtracks, sound effects, and even dialogue. It works by using a diffusion model trained with visual inputs, natural language prompts, and video annotations to gradually refine random noise into audio that fits the tone and context of videos.
Google DeepMind says V2A can "understand raw pixels" therefore you don't actually need a text prompt to generate the audio, but it does help with the accuracy. The model can also be prompted to make the tone of the audio sound positive or negative. Along with the announcement, DeepMind released some demo videos, including a video of a dark, creepy hallway accompanied by horror music, a lone cowboy at sunset scored to a mellow harmonica tune, and an animated figure talking about its dinner.
V2A will include Google's SynthID watermarking as a safeguarding measure against misuse, and Deepmind's blog post says the feature is currently undergoing testing before it's released to the public.
Topics Artificial Intelligence Google
The Anatomy of Liberal Melancholy
9 websites to download Lightroom presets to up your photography game
'If you can't handle me at my worst' has evolved into a bigger, better meme
Pete Souza needs to take a break from trolling Trump on Instagram
Whale Vomit Episode 5: Startup Monarchy
The best new FaceTime features on iOS 15
How to see what Twitter Lists you're on
Robinhood data breach exposes 7 million users' personal information
Operation Mensch
Will 'Sex Chocolates' make you horny? I tried them to find out.
The fat bears are already extremely fat
Remember Apple's $19 cleaning cloth? Well, Samsung is giving away its own for free.
No one can tell if this Lindsay Lohan video is an April Fools' Day prank or not
Surgeon general shares guide to fighting online vaccine misinformation
Amazon Prime Grubhub deal: Save $10 off orders of $20 or more
No one can tell if this Lindsay Lohan video is an April Fools' Day prank or not
The Rock finally explains his beef with Vin Diesel on 'Fate of the Furious'
Newspaper tries to be patriotic, accidentally satirises Brexit
The State of PC Gaming in 2016
Let's talk about the Guardians of the Galaxy
Now that SXSW is over, here was, for sure, my favorite partBlizzard remastered the original 'StarCraft' so you can game like it's 199810 people afflicted by the failure of TrumpcareHey, Paul Ryan: Twitter thinks it's time to call your officeThis week in apps: Mario 'runs' onto Android, Uber for teens and a Google search redesignAfter United Airlines incident, women share stories of being shamed for their clothingGoogle now offers a free Android app every weekLittle hedgehog rolls off a pink pillow to save your MondayFacebook Messenger update helps you find your friend's exact locationGoogle now offers a free Android app every weekGoogle now offers a free Android app every weekTesla Solar Tiles will be available to order starting in AprilBill Murray joyously celebrating his son's March Madness upset will make you happyJohn Legend just had a very dramatic airport experienceGoogle now offers a free Android app every weekLittle hedgehog rolls off a pink pillow to save your MondayThese hilarious memes have taken over the Indian internetSamira Wiley and Lauren Morelli are now officially married and wow, it looked beautiful'Power Rangers' fans are hyped about that credits scene—here's why15 great excuses to not go out tonight Twitter showers Janet Jackson with love as Justin Timberlake returns to Super Bowl Fake follower factory Devumi denies Twitter bots post NYT exposé Apple offers free iPhone 7 repairs to devices with 'No Service' issue 'Harry Potter' books are still flying off the shelves with 500 million copies sold What critics thought of 'Black Panther': Review round up MashReads Podcast: Catching up with Neal Shusterman Survival guide for 'This is Us' Super Bowl Sunday episode & Jack's death 'Counter Release of Nunes memo overloads House website Samsung Galaxy S9 leaks in fancy new lilac purple color What it's like to live as a tea drinker in a coffee drinker's world Tech CEOs need to do more about racism and injustice Nintendo refuses to answer questions about Mario's sex life Tesla's helping Australia build 'world's largest virtual power plant' Download this: YouTube Go lets you watch videos without wasting data Librarians' sassy display perfectly sums up the kind of questions they have to deal with Buttcoin subreddit mocks Bitcoin troubles Apple reportedly looking into new iPhone X bug that breaks phone calls 'Solo' Super Bowl teaser shows Han joining the Empire. Or does it? Super Bowl dishes you can make without a Crock
1.9829s , 8200.015625 kb
Copyright © 2025 Powered by 【Watch Dark Fantasies (2010)】,Steady Information Network