YouTube is now testing a new tool that will use artificial intelligence to assist creators in automatically dubbing their videos into various languages, the company stated on Thursday at VidCon. YouTube collaborated with Aloud, an AI-powered dubbing service that is part of Google’s in-house incubator Area 120.
YouTube added support for multi-language audio tracks earlier this year, allowing artists to add dubbing to new and current videos, allowing them to reach a larger worldwide audience. As of June 2023, producers had dubbed over 10,000 videos in over 70 languages.
Previously, creators had to work directly with third-party dubbing companies to make their audio tracks, which may be a time-consuming and costly process. Aloud allows them to dub videos for free.
Also, see:
Micron Announces Up to $825 Million Investment in Gujarat Chip Factory
Applied Materials will invest $400 million to set up a new engineering center in India
Musk hopes to bring Tesla and Starlink to India after meeting with Prime Minister Modi
Aloud was initially presented by Google in 2022. The artificial intelligence-powered dubbing tool transcribes a video for the creator before translating and producing a dubbed version. Before Aloud generates the dub, creators can examine and adjust the transcription.
YouTube’s VP of Creator Products, Amjad Hanif, told the audience yesterday that the tool is being tested with hundreds of creators. The technology will soon be available to all developers, according to the business. Aloud is now accessible in three languages: English, Spanish, and Portuguese. However, more languages, such as Hindi and Bahasa Indonesian, will be included in the future.
YouTube, according to Hanif, is “working to make translated audio tracks sound like the creator’s voice, with more expression and lip sync.” According to YouTube, generative AI will enable Aloud to debut features such as voice preservation, improved emotion transfer, and lip reanimation in the future.
