YouTube's new AI-Powered tool enables automatic dubbing for video creators

YouTube has introduced a new tool that helps video creators translate their videos into different languages automatically.

| Updated on: Jun 24 2023, 11:18 IST
Top 5 Anime series on Netflix that you should be watching; Demon Slayer, Black Clover, more
1/6 Demon Slayer: Kimetsu no Yaiba - This fantasy shounen (aimed primarily at a young male audience) follows young Tanjiro Kamado who aims to become a Demon Slayer and find the demon that killed his family and turned his sister Nezuko into a demon. This is a great time to watch the series as the finale of season 3 just aired on June 18.  (Ufotable)
image caption
2/6 Black Clover - Set in a world filled with wizards, witches, and magic, this shounen follows Asta, a young boy born without any magic power who is given a rare grimoire that grants him anti-magic abilities, and Yuno, who was born as a prodigy with immense magical power and the talent to control wind magic.  (Crunchyroll)
image caption
3/6 Monster - This seinen (aimed primarily at young adult men, who are 18 or above) series is a psychological thriller that focuses on the story of Doctor Kenzou Tenma, a Japanese surgeon living in Dusseldorf, Germany whose life turns chaotic after getting himself involved with one of his former patients who is not what he seems.  (Netflix)
image caption
4/6 Code Geass - This sci-fi anime is one of the most highly-rated series you can watch on Netflix. The story revolves around Lelouch Lamperouge, a student in the fictional Holy Empire of Britannia, a dominant military nation. But things take a strange turn when Lelouch awakens an ancient power that can change the course of the world. (Netflix)
image caption
5/6 Jojo’s Bizarre Adventure - If you prefer something light-hearted yet filled with action, and at times, psychological warfare, then Jojo will be an anime series you would hate to miss. There are multiple stories, all revolving around a protagonist named Jojo, and the magical ability that they possess.  (Netflix)
image caption
6/6 Bonus: Cowboy Bebop - This neo-noir space western anime series is a treat to watch. Although the animation and artwork are pretty dated given that the series first came out in 1997, the story and the characters are some of the best you will see in anime storytelling.  (Netflix)
icon View all Images
YouTube introduces aloud AI-Powered dubbing feature for creators. (AFP)

YouTube has introduced a new tool that helps video creators translate their videos into different languages automatically. This tool uses AI, which stands for artificial intelligence, to do the translation. The announcement was made by YouTube at a conference called VidCon, TechCrunch reported. YouTube has partnered with a company called Aloud, which also uses AI to dub videos. Aloud is part of Google's in-house incubator called Area 120.

Earlier this year, YouTube added a feature that allows creators to have multiple audio tracks in different languages. This means creators can add dubbing to their videos so that people who speak other languages can understand them. By June 2023, creators have already dubbed more than 10,000 videos in over 70 languages.

Before this new tool, creators had to work with other companies that provide dubbing services. This could take a lot of time and money. However, with Aloud, creators can now dub their videos for free.

Aloud was created by Google in 2022. It uses AI to transcribe a video, translate it, and then create a dubbed version. Creators can check and edit the transcription before Aloud makes the dub.

YouTube is currently testing this tool with hundreds of creators. The Vice President of Creator Products at YouTube, Amjad Hanif, mentioned this to the audience at the conference. Hanif also said that YouTube will make this tool available to all creators soon. Right now, Aloud is only available in English, Spanish, and Portuguese. But in the future, there will be more languages, such as Hindi and Bahasa Indonesian.

Hanif also mentioned that YouTube is working on making the translated audio tracks sound like the creator's voice. They want the dubbed version to have the same expression and lip movements as the original. YouTube confirmed to TechCrunch that they plan to use generative AI to add more features to Aloud, such as preserving the creator's voice, improving the transfer of emotions, and reanimating lip movements.

Follow HT Tech for the latest tech news and reviews , also keep up with us on Whatsapp channel,Twitter, Facebook, Google News, and Instagram. For our latest videos, subscribe to our YouTube channel.

First Published Date: 24 Jun, 11:18 IST