Requirements: Don't use torch 2.2

Pytorch released 2.2 without letting the community know first. Pin the torch version to 2.1.2 until exllamav2 builds for torch 2.2 Signed-off-by: kingbri <[email protected]>
theroyallab · Jan 30, 2024 · 3605067 · 3605067
1 parent 751627e
commit 3605067
Show file tree

Hide file tree

Showing 3 changed files with 6 additions and 3 deletions.
diff --git a/requirements-amd.txt b/requirements-amd.txt
@@ -1,6 +1,7 @@
 # Torch
+# Patch until torch 2.2 is supported
 --extra-index-url https://download.pytorch.org/whl/rocm5.6
-torch
+torch < 2.2, >= 2
 
 # Exllamav2
 https://github.com/turboderp/exllamav2/releases/download/v0.0.12/exllamav2-0.0.12+rocm5.6-cp311-cp311-linux_x86_64.whl; python_version == "3.11"

diff --git a/requirements-cu118.txt b/requirements-cu118.txt
@@ -1,6 +1,7 @@
 # Torch
+# Patch until torch 2.2 is supported
 --extra-index-url https://download.pytorch.org/whl/cu118
-torch
+torch < 2.2, >= 2
 
 # Exllamav2
 

diff --git a/requirements.txt b/requirements.txt
@@ -1,6 +1,7 @@
 # Torch
+# Patch until torch 2.2 is supported
 --extra-index-url https://download.pytorch.org/whl/cu121
-torch
+torch < 2.2, >= 2
 
 # Exllamav2