Stateful models by default#486

Closed

slyalin wants to merge 43 commits intohuggingface:mainfrom slyalin:stateful

+629-80

Commits on Dec 5, 2023

Allow loading of stateful models (no patching yet)
slyalin
committed

Commits on Dec 7, 2023

Commits on Dec 8, 2023

Commits on Dec 12, 2023

Commits on Dec 14, 2023

Commits on Dec 19, 2023

Commits on Dec 28, 2023

Allow loading of stateful models (no patching yet)

slyalin
authored and
eaidova
committed
Stateful models support

slyalin
authored and
eaidova
committed
Fix forward for chatglm

slyalin
authored and
eaidova
committed
Passing stateful as a dedicated parameter

slyalin
authored and
eaidova
committed
Fixed possibly misaligned types in ShapeOf Concat sub-expression

slyalin
authored and
eaidova
committed
Fixed critical typo in infer_request invocation

slyalin
authored and
eaidova
committed
Apply bettertransfomer when model is converted in stateful mode

slyalin
authored and
eaidova
committed
Correct default value handling for stateful flag

slyalin
authored and
eaidova
committed
Apply bettertransformer under try-except to avoid crashes when model is not supported

slyalin
authored and
eaidova
committed
Added --stateful option in optimum-cli

slyalin
authored and
eaidova
committed
Raise if too old version of opevino is used ans stateful=True

slyalin
authored and
eaidova
committed
Fix openvino version check to be compatible with openvino-nightly

slyalin
authored and
eaidova
committed
Fix for bloom family

slyalin
authored and
eaidova
committed
Fix general code style and appliy renaming suggestions
eaidova
committed
fix version checking if openvino not in site-packages
eaidova
committed
use reset_stateif available
eaidova
committed
remove input patch in bettertransformer apply
eaidova
committed
add tests
eaidova
committed
add type hints and update doc strings
eaidova
committed
added more tests
eaidova
committed

Commits on Jan 4, 2024

Commits on Jan 5, 2024