Skip to content

Commit

Permalink
fix dtype
Browse files Browse the repository at this point in the history
  • Loading branch information
l-bat committed Jul 22, 2024
1 parent 975d9a3 commit b6688d7
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -123,7 +123,7 @@ trade-offs after optimization:

**Symmetric Compression** - ``INT4_SYM``

INT4 Symmetric mode involves quantizing weights to an unsigned 4-bit integer
INT4 Symmetric mode involves quantizing weights to a signed 4-bit integer
symmetrically without zero point. This mode is faster than the INT8_ASYM, making
it ideal for situations where **speed and size reduction are prioritized over accuracy**.

Expand Down

0 comments on commit b6688d7

Please sign in to comment.