Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a template bundle with all features tensorboard, mlflow, dice per label #698

Open
AHarouni opened this issue Oct 10, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@AHarouni
Copy link

Is your feature request related to a problem? Please describe.
Bundles is very powerful and have lots of features but user need to collect pieces of code from different tutorials
It would be nice to have 1 bundle showing all features below

  • mlflow --> with flag to disable it if user doesn't need it
  • tensorbaord --> with flag to disable it if user doesn't need it
  • create different folder for each experiment to same the checkpoint model
  • copy json files used into the experiments folder

Describe the solution you'd like

As for the structure we should have

  • Have training.json with main training configs including
  • Have hypterparamter.json to override hyper parameters
  • infer.json to run inference, should also use hyperparamter to get parameters as resolution, intensity range, model dir

this setup should allow user to run multiple experiments just by changing the hyper paramter

Describe alternatives you've considered
I came close to creating this myself but it was lots of trial and error. bundles should provide it all out of the box

@ericspod
Copy link
Member

Hi @AHarouni thanks for some great ideas. I think we should do a template bundle that is about bells and whistles like this. For the different folder option, we have this in the template segmentation bundle. For copying the json (or other files) over to this directory, it would be cleaner if more meta information was available to the bundle about itself, that is what arguments were used, what files were loaded, what the current configuration is, etc. I have thought of these enhancements for the bundle code and will discuss these for the 1.5 release.

For the hyperparameter file, I use myself a common.json/yaml file in my bundles defining the network, output directory, base loading transforms, and other things which are common to all "script" configs. I would like this to be standard but this isn't compatible with MONAILabel and other things, so bundles in the zoo haven't done this. We can put this into this proposed bundle anyway and see about future changes to allow it.

@ericspod ericspod added the enhancement New feature or request label Oct 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Backlog
Development

No branches or pull requests

2 participants