Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Introduce support for NF4 data type for OV weight compression #988

Merged
merged 6 commits into from
Nov 13, 2024
Merged

Introduce support for NF4 data type for OV weight compression #988

merged 6 commits into from
Nov 13, 2024

Commits on Nov 13, 2024

  1. Add NF4 weight format

    @l-bat
    l-bat committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    1e35f0b View commit details
    Browse the repository at this point in the history

  2. remove test

    @l-bat
    l-bat committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    eba203e View commit details
    Browse the repository at this point in the history

  3. Update optimum/intel/openvino/configuration.py 

    Co-authored-by: Nikita Savelyev <[email protected]>
    @l-bat @nikita-savelyevv
    l-bat and nikita-savelyevv committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    4a19ae7 View commit details
    Browse the repository at this point in the history

  4. Update optimum/intel/openvino/configuration.py 

    Co-authored-by: Nikita Savelyev <[email protected]>
    @l-bat @nikita-savelyevv
    l-bat and nikita-savelyevv committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    ce0fc56 View commit details
    Browse the repository at this point in the history

  5. Add extra checks

    @l-bat
    l-bat committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    ecdd071 View commit details
    Browse the repository at this point in the history

  6. apply black

    @l-bat
    l-bat committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    4c2a3ee View commit details
    Browse the repository at this point in the history