Skip to content

Commit

Permalink
Update backup-precision option description
Browse files Browse the repository at this point in the history
  • Loading branch information
nikita-savelyevv committed Dec 9, 2024
1 parent 4d73e51 commit 413198c
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions docs/source/openvino/export.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -84,8 +84,8 @@ Optional arguments:
The group size to use for quantization. Recommended value is 128 and -1 uses per-column
quantization.
--backup-precision {none,int8_sym,int8_asym}
Defines a backup precision for mixed-precision weight compression. Only valid for int4 weight
format. If not provided, backup precision is int8_asym. 'none' stands for original floating-
Defines a backup precision for mixed-precision weight compression. Only valid for 4-bit weight
formats. If not provided, backup precision is int8_asym. 'none' stands for original floating-
point precision of the model weights, in this case weights are retained in their original
precision without any quantization. 'int8_sym' stands for 8-bit integer symmetric quantization
without zero point. 'int8_asym' stands for 8-bit integer asymmetric quantization with zero
Expand Down
2 changes: 1 addition & 1 deletion optimum/commands/export/openvino.py
Original file line number Diff line number Diff line change
Expand Up @@ -123,7 +123,7 @@ def parse_args_openvino(parser: "ArgumentParser"):
choices=["none", "int8_sym", "int8_asym"],
default=None,
help=(
"Defines a backup precision for mixed-precision weight compression. Only valid for int4 weight format. "
"Defines a backup precision for mixed-precision weight compression. Only valid for 4-bit weight formats. "
"If not provided, backup precision is int8_asym. 'none' stands for original floating-point precision of "
"the model weights, in this case weights are retained in their original precision without any "
"quantization. 'int8_sym' stands for 8-bit integer symmetric quantization without zero point. 'int8_asym' "
Expand Down

0 comments on commit 413198c

Please sign in to comment.