Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regarding the results in Table 8 and Table 14 #177

Open
Statisticss opened this issue Feb 4, 2024 · 0 comments
Open

Regarding the results in Table 8 and Table 14 #177

Statisticss opened this issue Feb 4, 2024 · 0 comments

Comments

@Statisticss
Copy link

Hi,
I have a question regarding the results in Table 8 and Table 14 (05 Dec., 2023 version).

In Table 8, for 7B context length 8192, the ppl for full FT is 8.02 and the ppl for LongLoRA is 8.04.
In Table 14, for 7B context length 8192, the ppl for full FT is 6.98 and the ppl for LongLoRA is 7.14.

According to the description, I think the only difference between Table 8 and 14 is, for Table 8 you used PG19 validation set and for Table 14 you used PG19 test set. Am I understanding correctly? If so, why is there such a big difference between validation and test set?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant