Skip to content

Commit

Permalink
Update docs/articles_en/openvino-workflow/model-optimization-guide/we…
Browse files Browse the repository at this point in the history
…ight-compression.rst

Co-authored-by: Alexander Kozlov <[email protected]>
  • Loading branch information
l-bat and AlexKoff88 authored Oct 18, 2024
1 parent 7b3ad7e commit 39395ca
Showing 1 changed file with 2 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -237,6 +237,8 @@ trade-offs after optimization:
There are three modes: INT8_ASYM, INT8_SYM, and NONE, which retains
the original floating-point precision of the model weights (``INT8_ASYM`` is default value).

**Use synthetic data for LLM weight compression**

It is possible to generate a synthetic dataset using the `nncf.data.generate_text_data` method for
data-aware weight compression. The method takes a language model (e.g. from `optimum.intel.openvino`)
and a tokenizer (e.g. from `transformers`) as input and returns the list of strings generated by the model.
Expand Down

0 comments on commit 39395ca

Please sign in to comment.