Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Negative Loss, Zero Success and Zero AoC #21

Open
bit0123 opened this issue May 17, 2024 · 6 comments
Open

Negative Loss, Zero Success and Zero AoC #21

bit0123 opened this issue May 17, 2024 · 6 comments

Comments

@bit0123
Copy link

bit0123 commented May 17, 2024

Hi,
Thanks for the interesting paper and releasing the code.
I am facing the same issue ("TypeError: h5py objects cannot be pickled") while running with num_worker=4. However, the code works when i set num_worker=0 with some additional transformation of input image in the policy file.

The loss becomes negative after the first epoch for different algorithm with 0 success. Consequently, the AoC is 0.
Could you please comment on that.
Thanks

@wangair
Copy link

wangair commented Jun 14, 2024

Hi, Thanks for the interesting paper and releasing the code. I am facing the same issue ("TypeError: h5py objects cannot be pickled") while running with num_worker=4. However, the code works when i set num_worker=0 with some additional transformation of input image in the policy file.

The loss becomes negative after the first epoch for different algorithm with 0 success. Consequently, the AoC is 0. Could you please comment on that. Thanks

Hi!Have you solved this?

@BrightMoonStar
Copy link

I encountered the same problem. All the evaluation indicators were 0, including AOC, Success Rate ...

@BrightMoonStar
Copy link

BrightMoonStar commented Jun 25, 2024

What confuses me is that the following two projects based on LIBERO also have success rate = 0 and Aoc = 0. No matter how we train, the result is 0. Is it because the details of our configuration are incorrect? I would like to ask for your help. Thank you very much! @Cranial-XIX
https://github.com/UT-Austin-RPL/Lotus

@pengzhi1998
Copy link

pengzhi1998 commented Jun 28, 2024

After 20 epochs of training, the success rate would become larger than 0. And after 50 epochs of training, the average success rate is around 0.7. (for libero_object tasks)

@BrightMoonStar
Copy link

经过 20 个时期的训练后,成功率将大于 0。经过 50 个时期的训练后,平均成功率约为 0.7。(对于libero_object任务)

Have you ever tried libero-90? For libero-90, it seems the problem still exists for me. Thank you very much!

@Cranial-XIX
Copy link
Collaborator

The success rate on libero-90 is low by design (since there are 90 tasks), and in general, you might need over 20 epochs (like 25 - 35) to reach the peak result.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants