TensorRT options ORT_RUNTIME_EXCEPTION

[Dr-Electron]

Hi everyone,

I'm currently trying to switch from Cuda to TensorRT. I tried to set the v2 options following the c++ example [here].(https://onnxruntime.ai/docs/execution-providers/TensorRT-ExecutionProvider.html#execution-provider-options)

        const auto &api = Ort::GetApi();

        OrtTensorRTProviderOptionsV2 *tensorrt_options;
        Ort::ThrowOnError(api.CreateTensorRTProviderOptions(&tensorrt_options));

        std::vector<const char *> option_keys = {"device_id"};
        std::vector<const char *> option_values = {"1"};

        Ort::ThrowOnError(api.UpdateTensorRTProviderOptions(tensorrt_options, option_keys.data(), option_values.data(),
                                                            option_keys.size()));

But for some reason UpdateTensorRTProviderOptions throws an error with error code ORT_RUNTIME_EXCEPTION. Is the example outdated or am I doing something wrong? I guess at this time tensorRT isn't involved directly yet, so this should work on any hardware config.