Discussions

• 1 You must be logged in to vote

  ❓

  How to properly assign DOCKER_PATH while performing build customed onnx runtime for Android

  platform:mobile issues related to ONNX Runtime mobile; typically submitted using template

  JerichoHub asked Jan 5, 2024 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Using C++, I have obtained a cudaArray of a ID3D11Texture2D and converted it to rgb in cuda mem. How can I create an onnx value from it?

  rlewkowicz asked Jan 4, 2024 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Can I convert llama 2 "Chat" model into onnx using llama/convert_to_onnx.py script?

  Kainat-R asked Jan 3, 2024 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  How can I use CUDA with NodeJS bindings?

  ep:CUDA issues related to the CUDA execution provider

  fijipants asked Mar 31, 2022 in EP Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ❓

  Onnxruntime memory(RAM) usage for CUDAExecutionProvider seems higher than CPUExecutionProvider

  durgaivelselvan-mn-17532 asked Dec 26, 2023 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Compatibility with CUDA 12.1

  ep:CUDA issues related to the CUDA execution provider

  aripsam asked Dec 15, 2023 in General · Answered

  

  

  1
• 1 You must be logged in to vote

  ❓

  NotImplemented error when using a OneHotEncoder: {NOT_IMPLEMENTED : Could not find an implementation for Reshape(19) node with name 'Reshape'}

  davalle99 asked Dec 19, 2023 in Other Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Error exporting MPNet model to ONNX and load in ONNXRuntime despite supported

  zhangyilun asked Dec 15, 2023 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Out of memory exception

  wsla1 asked Dec 5, 2023 in Other Q&A · Unanswered

  

  

  1
• 4 You must be logged in to vote

  ❓

  Is it possible to set disabled_optimizers with C# API?

  api:CSharp issues related to the C# API

  asvyazin asked Dec 13, 2023 in API Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  ❓

  TensorRT options ORT_RUNTIME_EXCEPTION

  Dr-Electron asked Dec 11, 2023 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Re-using output of a model's inference as input of the next inference without IOBindings (in C#) for LLMs

  claeyzre asked Dec 8, 2023 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  how can i quantize an onnx model from float32 to int16 (bias and weights)?

  hu8813 asked Dec 10, 2023 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Is there a c++interface for onnxruntime tvm here?

  yfirecanfly asked Dec 9, 2023 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Question: how to install runtime on linux ?

  boxerab asked Jan 28, 2021 in General · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  ❓

  Do we support aarch64 UNIX builds without FP16?

  oddfacade asked Dec 4, 2023 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Quantization model recall drop around 5%.

  Rfank2021 asked Dec 1, 2023 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Training APIs on ONNXruntime web

  wittenator asked Nov 30, 2023 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Session requires model path?

  lilhoser asked Apr 11, 2023 in General · Answered

  

  

  

  

  6
• 2 You must be logged in to vote

  ❓

  Loading small models quickly

  zekronium asked Nov 28, 2023 in Other Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  ❓

  Quantizelinear of float16 -> int8 results unexpected

  SStarver asked Nov 24, 2023 in Other Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Non-zero status code returned while running MatMul node.

  vahmelk99 asked Nov 23, 2023 in Other Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  ❓

  How much memory to build the runtime?

  lidj22 asked Nov 21, 2023 in Other Q&A · Closed · Answered

  

  

  1
• 3 You must be logged in to vote

  #️⃣

  Implementing OpenCL backend

  artyom-beilis asked Nov 21, 2023 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  After converting pytorch to onnx my accuracy dropped a lot

  myfrndjk asked Nov 20, 2023 in Other Q&A · Closed · Unanswered

  

  

  0