Meta launches AI voice generation tool "Voicebox", supporting voice dubbing for metaverse characters, noise reduction, and other functions

share
Meta launches AI voice generation tool "Voicebox", supporting voice dubbing for metaverse characters, noise reduction, and other functions

Meta has announced the launch of a voice generation AI called "Voicebox," which will assist in editing and styling audio. Despite recent layoffs of over 10,000 employees and a reduction in focus on the NFT space, it is evident that Meta's enthusiasm for the metaverse and AI-related technologies remains undiminished by the bear market.

AI Can Help with Writing Copy and Generate Conversations

Meta showcased today (17) on its Blog the release of a new speech generation AI called "Voicebox", which focuses on diverse editing and sampling functions for voice, and is suitable for both music and video content.

Voicebox is a generative AI model that focuses on voice generation, helping creators easily edit audio tracks, allowing virtual characters in the metaverse to produce natural sounds, enabling visually impaired individuals to hear AI read written information in their own voices, and allowing people to speak any foreign language in their own conversational style.

Detailed features include:

  • Text-to-Speech: Input text or sentences to obtain the corresponding audio track, with the option to choose up to six different speaking styles that are human-like.

  • Voice Editing: Voicebox can handle tasks like removing speech errors or noise interference effortlessly. By trimming damaged segments, Voicebox can regenerate the content of that section.
  • Cross-Language Style Conversion: This feature helps people communicate in a more natural and authentic manner, enhancing social feedback.

Despite Major Layoffs in Metaverse Division, Meta Remains in the Industry

According to previous reports, Meta's Metaverse division and Reality Labs incurred losses of nearly $4 billion in the first quarter, a smaller amount compared to the $14 billion loss in 2022, but enough to unsettle investors.

However, it is widely known that Meta has not given up on its metaverse dream. Collaborations such as last month's partnership with BMW to apply AR and VR technologies to smart vehicles for a more efficient and enjoyable passenger experience in the long term, as well as the recently unveiled MR head-mounted device Meta Quest 3 weeks ago, demonstrate Meta's continued high interest in the metaverse vision.

(For a comparison between Meta Quest 3 and Apple Vision Pro, please refer to this article)

This steadfast belief can also be seen in Meta CEO Zuckerberg's Facebook post: