myshell-ai/openvoice

OpenVoice is an open-source voice cloning system developed by researchers at MIT and MyShell that lets you clone someone's voice from a short audio sample and then generate new speech in that cloned voice. This means you can give the system a brief recording of a person speaking, and it will reproduce speech with that same tone, accent, and vocal character, saying anything you specify in text, without needing hours of training data from that speaker. The technology addresses a key limitation in most voice synthesis systems: traditionally, cloning a new voice requires a large dataset of recordings from that specific speaker. OpenVoice takes a zero-shot approach, meaning it can generalize to new voices it has never seen during training, using just a few seconds of reference audio. There are two versions. Version 1 introduced accurate tone-color cloning (reproducing the distinctive quality of a voice), flexible control over emotion, rhythm, pauses, and intonation, and the ability to clone voices across languages even when neither the reference speaker's language nor the target language appeared in the training data. Version 2 improved audio quality, added native multilingual support for English, Spanish, French, Chinese, Japanese, and Korean, and was released under the MIT license allowing free commercial use. You would use OpenVoice when building a product that needs instant voice personalization, for example, dubbing videos into other languages while preserving a speaker's voice, creating personalized audiobooks, building voice assistants with custom voices, or accessibility tools. It has powered voice cloning on the myshell.ai platform with tens of millions of uses. The project is written in Python and builds on VITS and VITS2, neural network architectures designed for text-to-speech synthesis. It is released under the MIT license, meaning free use for both research and commercial applications.