Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Will it natively support other languages? #6

Closed
faceair opened this issue Feb 7, 2024 · 13 comments
Closed

Will it natively support other languages? #6

faceair opened this issue Feb 7, 2024 · 13 comments

Comments

@faceair
Copy link

faceair commented Feb 7, 2024

I saw that the readme described the training data mainly in English, and I was worried that it would not learn the prosody in other languages, for example, the prosody in Chinese should be very different from English.
Will it be possible to learn other languages in the future just by fine-tuning?

@INF800
Copy link

INF800 commented Feb 7, 2024

Yes, please elaborate more on:

Support for (cross-lingual) voice cloning with finetuning.
We have had success with as little as 1 minute training data for Indian speakers.

Can you please share the Indian speakers examples code and TTS results?

@AndreaPi
Copy link

AndreaPi commented Feb 7, 2024

Joining the chorus here! I would like to fine-tune this for Italian speech2speech. Could you release a tutorial on how to do this?

@juangea
Copy link

juangea commented Feb 8, 2024

I also want to raise this question, looking for spanish :)

The system looks fantastic.

@sidroopdaska
Copy link
Member

sidroopdaska commented Feb 9, 2024

Will it be possible to learn other languages in the future just by fine-tuning?

@faceair / anyone else here for that matter - until we release the fine-tuning code, are you open to testing this hypothesis with a LoRA implementation? It would greatly benefit the community. Others can adopt it for different languages too :)

@philpav
Copy link

philpav commented Feb 13, 2024

Looking forward to multilingual support!

@juangea
Copy link

juangea commented Feb 14, 2024

If there is some info on how to train the Lora and how to apply it, I’m all for it, in the end a LORA can be trained in consumer hardware like a 4090, isn’t it?

@MonojitBanerjee
Copy link

Will it be possible to learn other languages in the future just by fine-tuning?

@faceair / anyone else here for that matter - until we release the fine-tuning code, are you open to testing this hypothesis with a LoRA implementation? It would greatly benefit the community. Others can adopt it for different languages too :)
I can try that.

@bread-on-toast
Copy link

Will it be possible to learn other languages in the future just by fine-tuning?

@faceair / anyone else here for that matter - until we release the fine-tuning code, are you open to testing this hypothesis with a LoRA implementation? It would greatly benefit the community. Others can adopt it for different languages too :)

Sure, would be interested

@sidroopdaska
Copy link
Member

Please give us a few days, and we will share a reference implementation for this

@vatsalaggarwal
Copy link
Member

I've added some initial pointers to this here: #70 (comment)

@maepopi
Copy link

maepopi commented Mar 1, 2024

Would be interested for French LoRA here :)

@mzdk100
Copy link

mzdk100 commented Mar 3, 2024

Hope to support Chinese.

@vatsalaggarwal
Copy link
Member

I'm closing this issue in favour of #70 where active work seems to be happening!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests