163 lines
5.3 KiB
Markdown
163 lines
5.3 KiB
Markdown
<div align="center">
|
||
<div> </div>
|
||
<img src="logo.png" width="200"/>
|
||
</div>
|
||
|
||
## Introduction
|
||
MeloTTS is a **high-quality multi-lingual** text-to-speech library by [MyShell.ai](https://myshell.ai). Supported languages include:
|
||
|
||
| Language | Example |
|
||
| --- | --- |
|
||
| English | [Link](https://myshell-public-repo-hosting.s3.amazonaws.com/myshellttsbase/examples/en/EN-Default/speed_1.0/sent_000.wav) |
|
||
| English (American) | [Link](https://myshell-public-repo-hosting.s3.amazonaws.com/myshellttsbase/examples/en/EN-US/speed_1.0/sent_000.wav) |
|
||
| English (British) | [Link](https://myshell-public-repo-hosting.s3.amazonaws.com/myshellttsbase/examples/en/EN-BR/speed_1.0/sent_000.wav) |
|
||
| English (Indian) | [Link](https://myshell-public-repo-hosting.s3.amazonaws.com/myshellttsbase/examples/en/EN_INDIA/speed_1.0/sent_000.wav) |
|
||
| English (Australian) | [Link](https://myshell-public-repo-hosting.s3.amazonaws.com/myshellttsbase/examples/en/EN-AU/speed_1.0/sent_000.wav) |
|
||
| Spanish | [Link](https://myshell-public-repo-hosting.s3.amazonaws.com/myshellttsbase/examples/es/ES/speed_1.0/sent_000.wav) |
|
||
| French | [Link](https://myshell-public-repo-hosting.s3.amazonaws.com/myshellttsbase/examples/fr/FR/speed_1.0/sent_000.wav) |
|
||
| Chinese (mix EN) | [Link](https://myshell-public-repo-hosting.s3.amazonaws.com/myshellttsbase/examples/zh/ZH/speed_1.0/sent_008.wav) |
|
||
| Japanese | [Link](https://myshell-public-repo-hosting.s3.amazonaws.com/myshellttsbase/examples/jp/JP/speed_1.0/sent_000.wav) |
|
||
| Korean | [Link](https://myshell-public-repo-hosting.s3.amazonaws.com/myshellttsbase/examples/kr/KR/speed_1.0/sent_000.wav) |
|
||
|
||
Some other features include:
|
||
- The Chinese speaker supports `mixed Chinese and English`.
|
||
- Fast enough for `CPU real-time inference`.
|
||
|
||
## Install on Linux
|
||
```bash
|
||
git clone git@github.com:myshell-ai/MeloTTS.git
|
||
cd MeloTTS
|
||
pip install -e .
|
||
python -m unidic download
|
||
```
|
||
We welcome the open-source community to make this repo `Mac` and `Windows` compatible. If you find this repo useful, please consider contributing to the repo.
|
||
|
||
## Usage
|
||
|
||
### English with Multi Accents
|
||
```python
|
||
from melo.api import TTS
|
||
|
||
# Speed is adjustable
|
||
speed = 1.0
|
||
|
||
# CPU is sufficient for real-time inference.
|
||
# You can also change to cuda:0
|
||
device = 'cpu'
|
||
|
||
# English
|
||
text = "Did you ever hear a folk tale about a giant turtle?"
|
||
model = TTS(language='EN', device=device)
|
||
speaker_ids = model.hps.data.spk2id
|
||
|
||
# Default accent
|
||
output_path = 'en-default.wav'
|
||
model.tts_to_file(text, speaker_ids['EN-Default'], output_path, speed=speed)
|
||
|
||
# American accent
|
||
output_path = 'en-us.wav'
|
||
model.tts_to_file(text, speaker_ids['EN-US'], output_path, speed=speed)
|
||
|
||
# British accent
|
||
output_path = 'en-br.wav'
|
||
model.tts_to_file(text, speaker_ids['EN-BR'], output_path, speed=speed)
|
||
|
||
# Indian accent
|
||
output_path = 'en-india.wav'
|
||
model.tts_to_file(text, speaker_ids['EN_INDIA'], output_path, speed=speed)
|
||
|
||
# Australian accent
|
||
output_path = 'en-au.wav'
|
||
model.tts_to_file(text, speaker_ids['EN-AU'], output_path, speed=speed)
|
||
|
||
```
|
||
|
||
### Spanish
|
||
```python
|
||
from melo.api import TTS
|
||
|
||
# Speed is adjustable
|
||
speed = 1.0
|
||
|
||
# CPU is sufficient for real-time inference.
|
||
# You can also change to cuda:0
|
||
device = 'cpu'
|
||
|
||
text = "El resplandor del sol acaricia las olas, pintando el cielo con una paleta deslumbrante."
|
||
model = TTS(language='ES', device=device)
|
||
speaker_ids = model.hps.data.spk2id
|
||
|
||
output_path = 'es.wav'
|
||
model.tts_to_file(text, speaker_ids['ES'], output_path, speed=speed)
|
||
```
|
||
|
||
### French
|
||
```python
|
||
from melo.api import TTS
|
||
|
||
# Speed is adjustable
|
||
speed = 1.0
|
||
device = 'cpu' # or cuda:0
|
||
|
||
text = "La lueur dorée du soleil caresse les vagues, peignant le ciel d'une palette éblouissante."
|
||
model = TTS(language='FR', device=device)
|
||
speaker_ids = model.hps.data.spk2id
|
||
|
||
output_path = 'fr.wav'
|
||
model.tts_to_file(text, speaker_ids['FR'], output_path, speed=speed)
|
||
```
|
||
|
||
### Chinese
|
||
```python
|
||
from melo.api import TTS
|
||
|
||
# Speed is adjustable
|
||
speed = 1.0
|
||
device = 'cpu' # or cuda:0
|
||
|
||
text = "我最近在学习machine learning，希望能够在未来的artificial intelligence领域有所建树。"
|
||
model = TTS(language='ZH', device=device)
|
||
speaker_ids = model.hps.data.spk2id
|
||
|
||
output_path = 'zh.wav'
|
||
model.tts_to_file(text, speaker_ids['ZH'], output_path, speed=speed)
|
||
```
|
||
|
||
### Japanese
|
||
```python
|
||
from melo.api import TTS
|
||
|
||
# Speed is adjustable
|
||
speed = 1.0
|
||
device = 'cpu' # or cuda:0
|
||
|
||
text = "彼は毎朝ジョギングをして体を健康に保っています。"
|
||
model = TTS(language='JP', device=device)
|
||
speaker_ids = model.hps.data.spk2id
|
||
|
||
output_path = 'jp.wav'
|
||
model.tts_to_file(text, speaker_ids['JP'], output_path, speed=speed)
|
||
```
|
||
|
||
### Korean
|
||
```python
|
||
from melo.api import TTS
|
||
|
||
# Speed is adjustable
|
||
speed = 1.0
|
||
device = 'cpu' # or cuda:0
|
||
|
||
text = "안녕하세요! 오늘은 날씨가 정말 좋네요."
|
||
model = TTS(language='KR', device=device)
|
||
speaker_ids = model.hps.data.spk2id
|
||
|
||
output_path = 'kr.wav'
|
||
model.tts_to_file(text, speaker_ids['KR'], output_path, speed=speed)
|
||
```
|
||
|
||
## License
|
||
This library is under MIT License. Free for both commercial and non-commercial use.
|
||
|
||
## Acknowledgement
|
||
This implementation is based on several excellent projects, [TTS](https://github.com/coqui-ai/TTS), [VITS](https://github.com/jaywalnut310/vits), [VITS2](https://github.com/daniilrobnikov/vits2) and [Bert-VITS2](https://github.com/fishaudio/Bert-VITS2). We appreciate their awesome work!
|