-
Notifications
You must be signed in to change notification settings - Fork 149
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Explain torch compile error messages, improve PTQ vs QAT doc #730
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks ! But I don't think it entirely closes https://github.com/zama-ai/concrete-ml-internal/issues/4414 as this issue is more about the error message itself. But yes great to add it in the doc
also might be worth to consider https://github.com/zama-ai/concrete-ml-internal/issues/4498 in this PR as well, if possible 🙏 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I suggest the following format for users to easily find solutions when they encounter some errors. Wdyt?
Common Compilation erros
Bit width limits
Error message: This is the error message
Cause: This error can occur when rounding_threshold_bits is not used and accumulated intermediate values in the computation exceed 16-bits. TLU input maximum bit-width is exceeded
Possible solutions:
- Reduce quantization n_bits. However, this may reduce accuracy. When quantization n_bits must be below 6, it is best to use Quantization Aware Training.
- Use rounding_threshold_bits. This feature is described here. It is recommended to use the fhe.Exactness.APPROXIMATE setting, and set the rounding bits to 1 or 2 bits higher than the quantization n_bits
- Use pruning
Crypto-parameters
Error message: This is the error message
Cause: This is the cause
Possible sulutions:
- Solution 1
- Solution 2
Quantization
Error message: This is the error message
Cause: This is the cause
Possible sulutions:
- Solution 1
- Solution 2
Co-authored-by: yuxizama <[email protected]>
Co-authored-by: yuxizama <[email protected]>
Co-authored-by: yuxizama <[email protected]>
Co-authored-by: yuxizama <[email protected]>
Co-authored-by: yuxizama <[email protected]>
Co-authored-by: yuxizama <[email protected]>
Co-authored-by: yuxizama <[email protected]>
Co-authored-by: yuxizama <[email protected]>
Co-authored-by: yuxizama <[email protected]>
Co-authored-by: yuxizama <[email protected]>
Coverage passed ✅Coverage details
|
Closes https://github.com/zama-ai/concrete-ml-internal/issues/4497
Closes https://github.com/zama-ai/concrete-ml-internal/issues/4387
Closes https://github.com/zama-ai/concrete-ml-internal/issues/4487
Closes https://github.com/zama-ai/concrete-ml-internal/issues/4498