Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unable to execute the MultiPL-E task for python language #268

Open
manthan0227 opened this issue Sep 4, 2024 · 0 comments
Open

Unable to execute the MultiPL-E task for python language #268

manthan0227 opened this issue Sep 4, 2024 · 0 comments

Comments

@manthan0227
Copy link

manthan0227 commented Sep 4, 2024 •
edited
Loading

Hello, I am trying to execute bigcode-eval-harness for the MultiPL-E task then I can't do the generation for python language. I can generate the responses for the other 18 languages. Because if you look into the huggingface platform they don't have the humaneval-py dataset But this task is trying to load the dataset.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@manthan0227