Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added trt_compile configs for vista2d and vista3d #632

Merged
merged 4 commits into from
Sep 3, 2024

Conversation

borisfom
Copy link
Contributor

Fixes # .

Description

A few sentences describing the changes proposed in this pull request.

Status

Ready/Work in progress/Hold

Please ensure all the checkboxes:

  • Codeformat tests passed locally by running ./runtests.sh --codeformat.
  • In-line docstrings updated.
  • Update version and changelog in metadata.json if changing an existing bundle.
  • Please ensure the naming rules in config files meet our requirements (please refer to: CONTRIBUTING.md).
  • Ensure versions of packages such as monai, pytorch and numpy are correct in metadata.json.
  • Descriptions should be consistent with the content, such as eval_metrics of the provided weights and TorchScript modules.
  • Files larger than 25MB are excluded and replaced by providing download links in large_file.yml.
  • Avoid using path that contains personal information within config files (such as use /home/your_name/ for "bundle_root").

@yiheng-wang-nv
Copy link
Collaborator

Tested vista2d with a cellpose image:
normal inference takes ~1.9s
TRT inference takes ~1.5s

Tested vista3d with a Decathlon spleen image:
normal inference takes ~12.3s
TRT inference takes ~7.8s

I think we can merge this PR first, and add benchmark data later in a separate PR cc @Nic-Ma @binliunls

@yiheng-wang-nv
Copy link
Collaborator

/build

@yiheng-wang-nv yiheng-wang-nv enabled auto-merge (squash) September 3, 2024 06:31
@yiheng-wang-nv yiheng-wang-nv merged commit 4a0234b into Project-MONAI:dev Sep 3, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants