# Meta introduces Voicebox, does a first on Generative AI speech | Tech News (HT Tech) > Meta introduces Voicebox which produce high-quality audio clips in a wide variety of styles. # Meta introduces Voicebox, does a first on Generative AI speech ## Meta introduces Voicebox which produce high-quality audio clips in a wide variety of styles. Jun 17 2023, 23:59 IST ![Follow on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/follow-us-facebook.png) ![Follow on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/follow-us-facebook-hover.png) ![Share](https://images.hindustantimes.com/tech/static/revamp/images/png/Share.png) ![Share](https://images.hindustantimes.com/tech/static/revamp/images/png/Shareclicked.png) ![Share on WhatsApp](https://images.hindustantimes.com/tech/static/revamp/images/png/whatsapp.png) ![Share on WhatsApp](https://images.hindustantimes.com/tech/static/revamp/images/png/whatsapp-hover.png) ![Share on Twitter](https://images.hindustantimes.com/tech/static/revamp/images/png/twitter.png) ![Share on Twitter](https://images.hindustantimes.com/tech/static/revamp/images/png/twitter-hover.png) ![Share on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/facebook.png) ![Share on Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/facebook-hover.png) ![Bookmark](https://images.hindustantimes.com/tech/static/revamp/images/png/Bookmark.png) ![Bookmarked](https://images.hindustantimes.com/tech/static/revamp/images/png/Bookmarked.png) ![Voicebox can generalize to speech-generation tasks](https://images.hindustantimes.com/tech/img/2023/06/17/1600x900/346873766_274638798275632_8494050904807553947_n_1687026213007_1687026228246.png) Voicebox can generalize to speech-generation tasks (Meta AI) ![Author Photo](https://images.hindustantimes.com/tech/static/revamp/images/png/HTTech-new-circle-logo.png) ### By MEDHA JHA Meta AI researchers have moved a step forward in the field of generative AI for speech with the development of Voicebox. Unlike previous models, Voicebox can generalize to speech-generation tasks that it was not specifically trained for, demonstrating state-of-the-art performance. Voicebox is a versatile generative system for speech that can produce high-quality audio clips in a wide variety of styles. It can create outputs from scratch or modify existing samples. The model supports speech synthesis in six languages, as well as noise removal, content editing, style conversion, and diverse sample generation. Traditionally, generative AI models for speech required specific training for each task using carefully prepared training data. However, Voicebox adopts a new approach called Flow Matching, which surpasses diffusion models in performance. It outperforms existing state-of-the-art models like VALL-E for English text-to-speech tasks, achieving better word error rates (5.9% vs. 1.9%) and audio similarity (0.580 vs. 0.681), while also being up to 20 times faster. In cross-lingual style transfer, Voicebox surpasses YourTTS by reducing word error rates from 10.9% to 5.2% and improving audio similarity from 0.335 to 0.481. Also read click here. One of the main limitations of existing speech synthesizers is that they rely on monotonic. They clean data that is difficult to produce and limited in quantity. However, Voicebox overcomes this limitation by leveraging the non-deterministic mapping capabilities of the Flow Matching model. This allows Voicebox to learn from a diverse range of speech data without the need for meticulous labeling. The model was trained on over 50,000 hours of recorded speech and transcripts from public domain audiobooks in multiple languages. Voice box can perform a variety of task including: 1-In-context text-to-speech synthesis: Voicebox's versatility enables it to excel in various speech generation tasks. It can perform in-context text-to-speech synthesis by matching the audio style of a given input sample and using it for generating speech from text. This capability has potential applications in assisting people who are unable to speak or customizing voices for non-player characters and virtual assistants. 2-Cross-lingual style transfer: Voicebox demonstrates proficiency in cross-lingual style transfer. By providing a sample of speech and a text passage in one of the supported languages, i.e English, French, German, Spanish, Polish, or Portuguese, Voicebox can produce a reading of the text in that language. This feature has the potential to facilitate natural and authentic communication between individuals who speak different languages. 3-Speech denoising and editing: Voicebox also excels in speech denoising and editing tasks. Leveraging its in-context learning, the model can generate speech to seamlessly edit segments within audio recordings. It can replace misspoken words or synthesize portions corrupted by short-duration noise, without requiring the re-recording of the entire speech. This capability simplifies the process of cleaning up and editing audio recordings, similar to popular image-editing tools for adjusting photos. 4- Voicebox's ability to learn from diverse, real-world data allows it to generate speech that better represents how people naturally communicate in the six supported languages. This capability can be leveraged to generate synthetic data for training speech assistant models. Models trained on Voicebox-generated synthetic speech exhibit similar performance to models trained on real speech, with only a 1% error rate degradation compared to the significant degradation observed with synthetic speech from previous text-to-speech models. While the researchers acknowledge the exciting use cases for generative speech models, they have decided not to make the Voicebox model or code publicly available at this time due to the potential risks of misuse. Responsible development and use of AI are paramount, and striking a balance between openness and responsibility is crucial. Instead, the researchers have shared audio samples and a research paper detailing the approach, results, and the creation of an effective classifier to distinguish between authentic speech and audio generated with Voicebox. Catch all the Latest Tech News, Mobile News, Laptop News, Gaming news, Wearables News , How To News, also keep up with us on Whatsapp channel,Twitter, Facebook, Google News, and Instagram. For our latest videos, subscribe to our YouTube channel. 17 Jun, 23:58 IST ### Related Stories 07 Oct 2026 71,687,025,962,593 NEXT ARTICLE BEGINS ![View all](https://images.hindustantimes.com/tech/static/revamp/images/png/view-all-icon.png) ## Tips & Tricks ![Ghibli-style art](https://images.hindustantimes.com/tech/img/2025/03/28/414x233/ChatGPT_Ghibli_style_images_1743161814450_1743161814596.jpg) ### How to turn your photos into Ghibli-style art with ChatGPT for free: Step-by-step guide ![How to create an invitation using iPhone’s new Apple Invites app- Step-by-step guide](https://images.hindustantimes.com/tech/img/2025/02/14/414x233/invites_1738728829564_1739543695649.png) ### How to create an invitation using iPhone’s new Apple Invites app- Step-by-step guide ![Apple TV app arrives on Android phones and tablets: What you get and how to install it](https://images.hindustantimes.com/tech/img/2025/02/13/414x233/unnamed_1739426557335_1739426567634.jpg) ### Apple TV app arrives on Android phones and tablets: What you get and how to install it ![Vodafone Idea OTT plans](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Vodafone Idea users can now stream 17 OTT apps with one subscription: Here's how ![Android data transfer methods](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### How to transfer data from one Android to another using Google backup, USB-C cable, and more ## Editor’s Pick ![iPhone 16e launched with A18 chip, Apple AI—bringing flagship power on a budget: Check specs, price](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### iPhone 16e launched in India: All details about the new budget mobile from Apple ![DeepSeek was founded in China with only a fraction of the budget of the top AI companies in the US.](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### DeepSeek AI: How it works, who’s behind it, how it’s different from ChatGPT, and its big US market impact explained ![iPhone 17 Air likely to get this feature that iPhone 17 Pro models may miss out on](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### iPhone 17 Air likely to get this feature that iPhone 17 Pro models may miss out on ![Google Whisk AI explained: How remixing works, availability, and how it differs from Gemini](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Google Whisk AI explained: How remixing works, availability, and how it differs from Gemini ![iOS 18.4 beta arriving soon: Know why it is the biggest iPhone update](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### iOS 18.4 beta arriving soon: Know why it is the biggest iPhone update ## Trending Stories ![Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order ![Infinix Note 50s 5G+](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Infinix Note 50s 5G+ set to launch in India with 64MP camera and MediaTek Dimensity 7300 SoC ![Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more ![Apple Intelligence AI training](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Apple plans to train AI using your on-device data without accessing personal content or emails: Report ![CMF Buds 2](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### CMF Buds 2 key features and price revealed ahead of April 28 launch: Details inside keep up with tech ![Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-facebook.png) ![Twitter](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-twitter.png) ![WhatsApp](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-whatsApp.png) ![Facebook](https://images.hindustantimes.com/tech/static/revamp/images/png/tech-facebook.png) ## Gaming ![Check out these five gaming monitors under ₹20,000,](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Top 5 gaming monitors under ₹20000 you should consider ![gaming consoles](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Grab gaming consoles at discounted rates during Amazon Great Indian Festival: Up to 72% off ![Pokémon GO Wild Area 2025](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Pokémon GO Wild Area 2025 to bring Grimmsnarl family, Shiny Hatenna, and global challenges ![Shade Silver](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Shade Silver free on Steam for a limited time: Here’s how to get it ![Call of duty](https://images.hindustantimes.com/tech/static/revamp/images/png/ht-tech-bg-img-90-66.png) ### Call of Duty: Black Ops 7 skips Switch 2 at launch, release date and price leak ![View all](https://images.hindustantimes.com/tech/static/revamp/images/png/view-all-icon.png) ## Trending News ### Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order ![Airtel 5G SIM card will now be delivered in 10 minutes with Blinkit- How to order](https://images.livemint.com/static/static/1x1_img.gif) ### Infinix Note 50s 5G+ set to launch in India with 64MP camera and MediaTek Dimensity 7300 SoC ![Infinix Note 50s 5G+](https://images.livemint.com/static/static/1x1_img.gif) ### Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more ![Xiaomi X Pro QLED Series sale starts in India: Check price, availability, and more](https://images.livemint.com/static/static/1x1_img.gif) ### Apple plans to train AI using your on-device data without accessing personal content or emails: Report ![Apple Intelligence AI training](https://images.livemint.com/static/static/1x1_img.gif) ### CMF Buds 2 key features and price revealed ahead of April 28 launch: Details inside ![CMF Buds 2](https://images.livemint.com/static/static/1x1_img.gif) ## Trending Gadgets Mobiles Laptops Tablets ![HT Tech](https://images.hindustantimes.com/tech/static/revamp/images/png/HT_tech-new.gif) - https://tech.hindustantimes.com/tech/news/meta-introduces-voicebox-does-a-first-on-generative-ai-speech-71687025962593.html