DocTR PyTorch: CPU-Only Version

[jayanthsaish]

I am encountering an issue in production where the doctr package includes CUDA dependencies, which significantly increase its size. However, I only need the CPU version. Could you please advise where I can find a CPU-only version?

Currently, I am installing it using pip install python-doctr, I have already downloaded Torch separately.

[felixdittrich92]

Hi @jayanthsaish 👋,

You have installed the cpuonly version before:

pip:

pip3 install torch torchvision --index-url https://download.pytorch.org/whl/cpu

conda:

conda install pytorch torchvision cpuonly -c pytorch

?

For prod systems you can also take a look here:
https://github.com/felixdittrich92/OnnxTR --> no PyTorch or TensorFlow required / much faster / more lightweight

[felixdittrich92]

real latency benchmarks:
https://github.com/felixdittrich92/OnnxTR?tab=readme-ov-file#benchmarks

[jayanthsaish]

Okay thank you : )