MyShell’s OpenVoice: The Latest Breakthrough in Voice Cloning AI Technology

Introducing OpenVoice: A Revolutionary Open-Source AI for Voice Cloning

OpenVoice is a cutting-edge open-source AI developed by a collaboration of researchers at MIT, Tsinghua University, and Canadian startup MyShell. It introduces unprecedented speed and accuracy for voice cloning using just seconds of audio input. This technology allows for precise manipulation of various voice qualities such as tone, emotion, accent, rhythm, and more.

Features of OpenVoice

• Allows editing of voice qualities such as tone, emotion, accent, rhythm, and more
• Can clone voices with very little data
• Generates cloned speech significantly faster than other alternatives

Dual AI Models for Voice Cloning

OpenVoice comprises two AI models working together for text-to-speech conversion and voice tone cloning. The first model handles language style, accents, emotion, and other speech patterns. It was trained on 30,000 audio samples with varying emotions from English, Chinese, and Japanese speakers. The second “tone converter” model learned from over 300,000 samples encompassing 20,000 voices. By combining these models with a user-provided voice sample, OpenVoice can clone voices with very little data, resulting in faster voice cloning compared to other methods such as Meta’s Voicebox.

Canadian Startup MyShell

MyShell, the Calgary-based startup that developed OpenVoice, was founded in 2023 and has already gained $5.6 million in early funding. The startup has over 400,000 users and offers a decentralised platform for creating and discovering AI apps. Apart from voice cloning, MyShell provides original text-based chatbot personalities, meme generators, user-created text RPGs, and more, some of which are available through subscription fees. The company also charges bot creators to promote their bots on its platform.

Benefits of Open-Sourcing Voice Cloning

MyShell is promoting an open model of AI development by open-sourcing its voice cloning capabilities through HuggingFace while monetizing its broader app ecosystem. This approach stands to increase users across both domains and advance openness and accessibility in the AI field.

Learn More at AI & Big Data Expo

Take a deep dive into AI and big data from industry leaders at the AI & Big Data Expo, co-located with Digital Transformation Week. These events are set to happen in Amsterdam, California, and London, providing comprehensive insights and discussions about emerging technologies.