Skip to content

Commit

Permalink
Update
Browse files Browse the repository at this point in the history
[ghstack-poisoned]
  • Loading branch information
vkuzo committed Feb 14, 2025
1 parent 4de0f68 commit 060cda8
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ Post-training quantization can result in a fast and compact model, but may also
```python
from torchao.quantization import (
quantize_,
int8_dynamic_activation_int4_weight,
Int8DynamicActivationInt4WeightConfig,
)
from torchao.quantization.qat import (
FakeQuantizeConfig,
Expand All @@ -83,7 +83,7 @@ quantize_(

# Convert fake quantization to actual quantized operations
quantize_(my_model, FromIntXQuantizationAwareTrainingConfig())
quantize_(my_model, int8_dynamic_activation_int4_weight(group_size=32))
quantize_(my_model, Int8DynamicActivationInt4WeightConfig(group_size=32))
```

### Float8
Expand Down

0 comments on commit 060cda8

Please sign in to comment.