Skip to content

Commit

Permalink
Update examples/neural_compressor/language-modeling/run_clm.py
Browse files Browse the repository at this point in the history
Co-authored-by: Ella Charlaix <[email protected]>
  • Loading branch information
PenghuiCheng and echarlaix authored Mar 23, 2024
1 parent 88760bc commit f51266a
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion examples/neural_compressor/language-modeling/run_clm.py
Original file line number Diff line number Diff line change
Expand Up @@ -228,7 +228,8 @@ class OptimizationArguments:
default="RTN",
metadata={"help": "Quantization methodology for weight only quantization. Choose from 'RTN' and 'GPTQ'."},
)
gptq_percdamp: float = field(
damp_percent: float = field(

default=0.01,
metadata={"help": "Percentage of Hessian's diagonal values average, which will be added to Hessian's diagonal to increase numerical stability, used for GPTQ quantization"},
)
Expand Down

0 comments on commit f51266a

Please sign in to comment.