Skip to content
This repository has been archived by the owner on Dec 8, 2023. It is now read-only.

English demo? #139

Open
impactcolor opened this issue Jan 12, 2023 · 3 comments
Open

English demo? #139

impactcolor opened this issue Jan 12, 2023 · 3 comments

Comments

@impactcolor
Copy link

Thank you for sharing the colab notebook.
Is there an example of english demo? In the current colab I have done the following:

I changed pretrained acoustic model to this:
config_path = "downloads/zh/muskit/exp/svs_with_lid/config.yaml" model_path = "downloads/zh/muskit/exp/svs_with_lid/119epoch.pth"

Which is from: Multilingual_four

Then I changed pretrained vcoder to this:
vocoder_config = "downloads/zh/pwg/config.yml" vocoder_checkpoint = "downloads/zh/pwg/checkpoint-1000000steps.pkl" print("successfully finished download vocoder")

Which is one of the models from results.
The final blocks gives me the error:
31 batch = sing_generation.preprocess_fn(str(row["id"]), info, 1.0) 32 batch = tensorify(batch) ---> 33 singing, _, _, _, _, _, _ = sing_generation(**batch)

I'm obviously doing something wrong. Can you give me any insight into how to do english models can be loaded?

@ftshijt
Copy link
Member

ftshijt commented Jan 24, 2023

Hi, thanks for your interest. Most of our contributors are in winter vacation due to the Chinese new year. Will back to you as soon as we are back. Before that, could you share your notebook with logs for us to check the issues?

@ftshijt
Copy link
Member

ftshijt commented Jan 24, 2023

Btw, FYI, we have merged most of the functionality of Muskits to ESPnet, where we gonna move our focus to there in the near future. We already have the SOTA VISinger in ESPnet-Muskits now.

@impactcolor
Copy link
Author

Hi thanks for your response. Is there a notebook for ESPnet-Muskits? @ftshijt

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants