Skip to content

Commit

Permalink
typo fix
Browse files Browse the repository at this point in the history
  • Loading branch information
jaysonzlin committed Oct 31, 2023
1 parent df6f496 commit 11e8e31
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion optimizations.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -506,7 +506,7 @@ Entropy: Use KL divergence to minimize information loss between the original flo

Percentile: Set the range to a percentile of the distribution of absolute values seen during calibration. For example, 99% calibration would clip 1% of the largest magnitude values.

![Histogram of input activatsions to layer 3 in ResNet50 and calibrated ranges (@intquantfordeepinf).](images/efficientnumerics_calibrationcopy.png)
![Histogram of input activations to layer 3 in ResNet50 and calibrated ranges (@intquantfordeepinf).](images/efficientnumerics_calibrationcopy.png)

Importantly, the quality of calibration can make a difference between a quantized model that retains most of its accuracy and one that degrades significantly. Hence, it's an essential step in the quantization process. When choosing a calibration range, there are two types: symmetric and asymmetric.

Expand Down

0 comments on commit 11e8e31

Please sign in to comment.