Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable validation/test stages in ESM-2 and Geneformer #492

Merged
merged 14 commits into from
Dec 12, 2024

Conversation

sichu2023
Copy link
Collaborator

@sichu2023 sichu2023 commented Dec 3, 2024

Summary

Allow --limit-val-batches=0. to disable validation. Same applies for testing in geneformer.

Details

Previously validation dataset cannot be created when limit_val_batches = 0.. Now this is caught and the validation dataset is set to None. Same applies to test dataset.

Tests

Implemented in sub-packages/bionemo-geneformer/tests/bionemo/esm2/scripts/test_train_esm2.py::test_val_dataloader_in_main_runs_with_limit_val_batches and that in geneformer.

Out of scope

  • The e2e test function only test whether it runs. It does not test whether validation is actually skipped.
  • Currently there is no testing on finetuning.

@sichu2023 sichu2023 changed the title Sichu/limit val batches=0p0 Disable validation/test stages in ESM-2 and Geneformer Dec 3, 2024
@sichu2023 sichu2023 enabled auto-merge (squash) December 3, 2024 14:15
@sichu2023 sichu2023 self-assigned this Dec 3, 2024
@sichu2023
Copy link
Collaborator Author

/build-ci

Copy link
Collaborator

@jstjohn jstjohn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you also add a test to lock in this support?

@sichu2023 sichu2023 disabled auto-merge December 3, 2024 15:20
@sichu2023
Copy link
Collaborator Author

Can you also add a test to lock in this support?

Will do. Just disabled auto-merge.

Copy link
Collaborator

@farhadrgh farhadrgh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would you add this support to infer/fintetune datamodule here as well?

@sichu2023 sichu2023 force-pushed the sichu/limit-val-batches=0p0 branch from b4a7b5f to a61d0b5 Compare December 4, 2024 14:47
@sichu2023 sichu2023 requested a review from farhadrgh December 4, 2024 14:53
@sichu2023
Copy link
Collaborator Author

/build-ci

@sichu2023 sichu2023 enabled auto-merge (squash) December 4, 2024 14:54
@sichu2023
Copy link
Collaborator Author

Would you add this support to infer/fintetune datamodule here as well?

Done!

@sichu2023 sichu2023 disabled auto-merge December 4, 2024 17:15
@sichu2023 sichu2023 force-pushed the sichu/limit-val-batches=0p0 branch 2 times, most recently from 0eeb34b to 2f89e94 Compare December 4, 2024 20:39
@sichu2023 sichu2023 enabled auto-merge (squash) December 4, 2024 20:39
@sichu2023
Copy link
Collaborator Author

/build-ci

@sichu2023 sichu2023 force-pushed the sichu/limit-val-batches=0p0 branch from ddc9672 to 8b50d57 Compare December 5, 2024 12:07
@sichu2023
Copy link
Collaborator Author

/build-ci

@sichu2023 sichu2023 force-pushed the sichu/limit-val-batches=0p0 branch from 8b50d57 to 386ad33 Compare December 12, 2024 08:56
@sichu2023
Copy link
Collaborator Author

/build-ci

@sichu2023
Copy link
Collaborator Author

/build-ci

@sichu2023 sichu2023 merged commit 06116d7 into main Dec 12, 2024
4 checks passed
@sichu2023 sichu2023 deleted the sichu/limit-val-batches=0p0 branch December 12, 2024 10:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants