Skip to content

Commit

Permalink
Update readme for weight-only quantization example
Browse files Browse the repository at this point in the history
  • Loading branch information
PenghuiCheng committed Oct 16, 2023
1 parent 92004e9 commit 9dd9fec
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/neural_compressor/language-modeling/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -97,4 +97,4 @@ respectively `dynamic`, `static`, `weight_only` or `aware_training`.

The flag `--verify_loading` can be passed along to verify that the resulting quantized model can be loaded correctly.

> **_Note:_** `weight_only` quantization_approach requires neural-compressor >= 2.3
> **_Note:_** `weight_only` quantization_approach requires neural-compressor >= 2.3 and intel-extension-for-transformers >= 1.2.

0 comments on commit 9dd9fec

Please sign in to comment.