Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loading the file to build the model failed #303

Open
AarenWu opened this issue Jul 13, 2022 · 2 comments
Open

Loading the file to build the model failed #303

AarenWu opened this issue Jul 13, 2022 · 2 comments

Comments

@AarenWu
Copy link

AarenWu commented Jul 13, 2022

When I load the model using the tensorRT model file generated by TF-TRT, the console displays the following information:
2022-07-13 16:42:54.914735: E tensorflow/compiler/tf2tensorrt/utils/trt_logger.cc:42] DefaultLogger coreReadArchive.cpp (38) - Serialization Error in verifyHeader: 0 (Version tag does not match)
2022-07-13 16:42:54.915035: E tensorflow/compiler/tf2tensorrt/utils/trt_logger.cc:42] DefaultLogger INVALID_STATE: std::exception
2022-07-13 16:42:54.915065: E tensorflow/compiler/tf2tensorrt/utils/trt_logger.cc:42] DefaultLogger INVALID_CONFIG: Deserialize the cuda engine failed.

My system environment is as follows:
CentOS =7.9.2009
Tython = 3.7.6
Tensorflow = 2.4
Nvidia-Driver=495.29.05
CUDA=11.0
cuDnn=8.0
TensorRT=7.2.1

About the tensorRT model file, I generated it with tf.experimental.tensorrt.Converter(), and I checked the assets folder under the save file path, there are many similar trt-serialized-engine.TRTEngineOp files generated, which were not generated using tf.saved_model.save() before

I am not sure if my tensorRT model file is generated correctly. Maybe, you can provide a method to verify this.

Below is the code of my conversion process:
image
企业微信截图_16577045396464

@AarenWu
Copy link
Author

AarenWu commented Jul 13, 2022

Addition:
GPU=Nvidia GA100

@ncomly-nvidia
Copy link

HI @AarenWu, TF 2.4 is almost 2 years old. Can you please see if this issue still exists in 2.9 or ToT?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants