Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

'vila_u' not found in lmms_eval #11

Closed
hqhQAQ opened this issue Dec 13, 2024 · 2 comments
Closed

'vila_u' not found in lmms_eval #11

hqhQAQ opened this issue Dec 13, 2024 · 2 comments

Comments

@hqhQAQ
Copy link

hqhQAQ commented Dec 13, 2024

It seems that vila_u is not supported in lmms_eval.
@zhuoyang20
Copy link
Collaborator

Hi @hqhQAQ,

We use vila_u-eval to do the evaluation as shown in the Evaluation part in our README. vila_u-eval is based on lmms-eval where vila_u is registered in https://github.com/mit-han-lab/vila-u/tree/main/vila_u/eval/lmms.

Best,
Zhuoyang

@hqhQAQ
Copy link
Author

hqhQAQ commented Jan 13, 2025

Thanks for your response!

@hqhQAQ hqhQAQ closed this as completed Jan 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hqhQAQ @zhuoyang20