Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
FP16 results:
![image](https://private-user-images.githubusercontent.com/78143172/347663205-9206dfaa-bbc9-41a5-8f3d-db23eb7b6b4b.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNTc0NzEsIm5iZiI6MTczOTM1NzE3MSwicGF0aCI6Ii83ODE0MzE3Mi8zNDc2NjMyMDUtOTIwNmRmYWEtYmJjOS00MWE1LThmM2QtZGIyM2ViN2I2YjRiLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDEwNDYxMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTlkNWYzMmE0OTQ5Y2UzZTY4OGI5MTNhMDY4OTI2ZmMzZDMzY2IzNmVkMDQzYzI4MGY4N2Q1ZTNiZDYwODg5ZTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.VaT0-V9aWBsw7lmSmfwtbSev-EClM_oEHNyM7Sgvz0k)
INT8 results:
![image](https://private-user-images.githubusercontent.com/78143172/347663017-5c82378b-3a13-40a8-9323-3ed4d3d71388.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNTc0NzEsIm5iZiI6MTczOTM1NzE3MSwicGF0aCI6Ii83ODE0MzE3Mi8zNDc2NjMwMTctNWM4MjM3OGItM2ExMy00MGE4LTkzMjMtM2VkNGQzZDcxMzg4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDEwNDYxMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTU5NTE4MmUzMjc0NTJlMTg1YjFkYjcyOWNlMzg1ZjFkZjBjYTFmMzE1Y2M5MTU1NGMxODkxMDkwODIxODRjNTgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.AJAYZCMV0UNSH86w3StScfEfZC8eamcLZ9vsF1hAHLE)
py results:
![image](https://private-user-images.githubusercontent.com/78143172/347674582-d8a70870-8b32-4e66-9c13-6b2e02219483.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNTc0NzEsIm5iZiI6MTczOTM1NzE3MSwicGF0aCI6Ii83ODE0MzE3Mi8zNDc2NzQ1ODItZDhhNzA4NzAtOGIzMi00ZTY2LTljMTMtNmIyZTAyMjE5NDgzLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDEwNDYxMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWU0MmYwMTRkM2IyNmY3YjcxZDRmNzUwMjUyODY3YWZjNWY3M2YzYzQ0NDM0NjQ5ZjczYjU1YmQxNjQ0NzJlNDImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.hFvoPmnUBBvy9-g_MWvWZs6OvrQK_uhGHYdOFqBIy_I)