Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error in TensorRT conversion of e5-large model #339

Open
ndeep27 opened this issue Jul 12, 2024 · 1 comment
Open

Error in TensorRT conversion of e5-large model #339

ndeep27 opened this issue Jul 12, 2024 · 1 comment

Comments

@ndeep27
Copy link

ndeep27 commented Jul 12, 2024

I am trying to convert the open source e5-large TF model to TensorRT. This is the model - https://huggingface.co/intfloat/multilingual-e5-large. I am getting below error

[libprotobuf FATAL external/com_google_protobuf/src/google/protobuf/stubs/stringpiece.cc:50] size too big: 18446744071659921560 details: string length exceeds max size

I also tried disabling the graph freezing by setting env var - TF_TRT_EXPERIMENTAL_FEATURES=disable_graph_freezing but I get below error for that

RuntimeError: Not found in the function captures: unknown_390:0

Any pointers on how can I resolve above?

@ndeep27
Copy link
Author

ndeep27 commented Jul 17, 2024

@DEKHTIARJonathan Can you please help with above?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant