Code

support stateful model#493

Code

Merged

echarlaix merged 84 commits intohuggingface:mainhuggingface/optimum-intel:mainfrom eaidova:ea/statefuleaidova/optimum-intel:ea/statefulCopy head branch name to clipboardJan 16, 2024

+574-91

Commits

Commits on Dec 5, 2023

• Allow loading of stateful models (no patching yet)

  slyalin

  committed
  d41110c

Commits on Dec 7, 2023

• Stateful models support

  slyalin

  committed
  bcb7cac

• Fix forward for chatglm

  slyalin

  committed
  d4c165b

Commits on Dec 8, 2023

• Passing stateful as a dedicated parameter

  slyalin

  committed
  a62dc6f

• Fixed possibly misaligned types in ShapeOf Concat sub-expression

  slyalin

  committed
  403adb5

Commits on Dec 12, 2023

• Merge remote-tracking branch 'origin/main' into stateful

  slyalin

  committed
  6097bfd

• Fixed critical typo in infer_request invocation

  slyalin

  committed
  c54a466

Commits on Dec 13, 2023

• Merge remote-tracking branch 'origin/main' into stateful

  slyalin

  committed
  6151bec

• Apply bettertransfomer when model is converted in stateful mode

  slyalin

  committed
  0e5aefc

• Correct default value handling for stateful flag

  slyalin

  committed
  5087f92

• Apply bettertransformer under try-except to avoid crashes when model is not supported

  slyalin

  committed
  5ae6d5c

• Added --stateful option in optimum-cli

  slyalin

  committed
  ddb182e

Commits on Dec 14, 2023

• Merge remote-tracking branch 'origin/main' into stateful

  slyalin

  committed
  8e9a7e0

• Raise if too old version of opevino is used ans stateful=True

  slyalin

  committed
  a51ab27

• Fix openvino version check to be compatible with openvino-nightly

  slyalin

  committed
  6df798a

Commits on Dec 19, 2023

• Merged from recent main branch

  slyalin

  committed
  fa33784

• Fix for bloom family

  slyalin

  committed
  aa299e6

Commits on Dec 28, 2023

• Allow loading of stateful models (no patching yet)

  

  slyalin

  authored and

  eaidova

  committed
  70ff804

• Stateful models support

  

  slyalin

  authored and

  eaidova

  committed
  bf45cc7

• Fix forward for chatglm

  

  slyalin

  authored and

  eaidova

  committed
  fafc040

• Passing stateful as a dedicated parameter

  

  slyalin

  authored and

  eaidova

  committed
  e4585fe

• Fixed possibly misaligned types in ShapeOf Concat sub-expression

  

  slyalin

  authored and

  eaidova

  committed
  a5c48c4

• Fixed critical typo in infer_request invocation

  

  slyalin

  authored and

  eaidova

  committed
  3ce4fe9

• Apply bettertransfomer when model is converted in stateful mode

  

  slyalin

  authored and

  eaidova

  committed
  00bd0b3

• Correct default value handling for stateful flag

  

  slyalin

  authored and

  eaidova

  committed
  489799a

• Apply bettertransformer under try-except to avoid crashes when model is not supported

  

  slyalin

  authored and

  eaidova

  committed
  312f24f

• Added --stateful option in optimum-cli

  

  slyalin

  authored and

  eaidova

  committed
  4bca339

• Raise if too old version of opevino is used ans stateful=True

  

  slyalin

  authored and

  eaidova

  committed
  a5f8558

• Fix openvino version check to be compatible with openvino-nightly

  

  slyalin

  authored and

  eaidova

  committed
  2763639

• Fix for bloom family

  

  slyalin

  authored and

  eaidova

  committed
  f5da152

• Fix general code style and appliy renaming suggestions

  eaidova

  committed
  da62d99

• fix version checking if openvino not in site-packages

  eaidova

  committed
  33f86dc

• use reset_stateif available

  eaidova

  committed
  7d15415

• remove input patch in bettertransformer apply

  eaidova

  committed
  0dfbb63

• add tests

  eaidova

  committed
  09bbe7b

• add type hints and update doc strings

  eaidova

  committed
  e70a50d

• added more tests

  eaidova

  committed
  a57c86a

Commits on Jan 4, 2024

• Merge remote-tracking branch 'origin/main' into ea/stateful

  slyalin

  committed
  67deae2

• Fixed outdated signature of InferRequest wrapper to fix one of the quantizer tests.

  slyalin

  committed
  89ba0cb

• Merge remote-tracking branch 'slyalin/stateful' into stateful

  slyalin

  committed
  a85960a

Commits on Jan 5, 2024

• Merge remote-tracking branch 'origin/main' into stateful

  slyalin

  committed
  dcfcc2a

• Switch to stateful model by default

  slyalin

  committed
  df0e727

• Merge remote-tracking branch 'origin/main' into stateful

  slyalin

  committed
  9992419

Commits on Jan 8, 2024

• Allow loading of stateful models (no patching yet)

  

  slyalin

  authored and

  eaidova

  committed
  1c815a0

• Stateful models support

  

  slyalin

  authored and

  eaidova

  committed
  132ae62

• Fix forward for chatglm

  

  slyalin

  authored and

  eaidova

  committed
  fa02a9e

• Passing stateful as a dedicated parameter

  

  slyalin

  authored and

  eaidova

  committed
  9094279

• Fixed possibly misaligned types in ShapeOf Concat sub-expression

  

  slyalin

  authored and

  eaidova

  committed
  14aeb55

• Apply bettertransfomer when model is converted in stateful mode

  

  slyalin

  authored and

  eaidova

  committed
  6594e70

• Correct default value handling for stateful flag

  

  slyalin

  authored and

  eaidova

  committed
  55c70fe

• Apply bettertransformer under try-except to avoid crashes when model is not supported

  

  slyalin

  authored and

  eaidova

  committed
  a1b41ac

• Added --stateful option in optimum-cli

  

  slyalin

  authored and

  eaidova

  committed
  a7d91b7

• Raise if too old version of opevino is used ans stateful=True

  

  slyalin

  authored and

  eaidova

  committed
  2aeaf68

• Fix openvino version check to be compatible with openvino-nightly

  

  slyalin

  authored and

  eaidova

  committed
  72e9149

• Fix for bloom family

  

  slyalin

  authored and

  eaidova

  committed
  4488836

• Fix general code style and appliy renaming suggestions

  eaidova

  committed
  843d364

• fix version checking if openvino not in site-packages

  eaidova

  committed
  361e06e

• use reset_stateif available

  eaidova

  committed
  0b8ba34

• remove input patch in bettertransformer apply

  eaidova

  committed
  6b88888

• add tests

  eaidova

  committed
  042944c

• add type hints and update doc strings

  eaidova

  committed
  662f615

• added more tests

  eaidova

  committed
  c75e40b

• Fixed outdated signature of InferRequest wrapper to fix one of the quantizer tests.

  

  slyalin

  authored and

  eaidova

  committed
  8531d3c

• Stateful models support

  

  slyalin

  authored and

  eaidova

  committed
  b9d42a7

• Fix forward for chatglm

  

  slyalin

  authored and

  eaidova

  committed
  841c8ec

• Passing stateful as a dedicated parameter

  

  slyalin

  authored and

  eaidova

  committed
  94ee68d

• Apply bettertransfomer when model is converted in stateful mode

  

  slyalin

  authored and

  eaidova

  committed
  7ce3eb4

• Raise if too old version of opevino is used ans stateful=True

  

  slyalin

  authored and

  eaidova

  committed
  7ead0e8

• Fix openvino version check to be compatible with openvino-nightly

  

  slyalin

  authored and

  eaidova

  committed
  49a7f8f

• Fix for bloom family

  

  slyalin

  authored and

  eaidova

  committed
  3bf4272

• fix conflict

  eaidova

  committed
  e2194b3

• Merge remote-tracking branch 'sl/stateful' into ea/stateful

  eaidova

  committed
  70d086a

• fix test and add beam_idx attribute

  eaidova

  committed
  6014294

• apply review comments

  eaidova

  committed
  045cc69

Commits on Jan 10, 2024

• stateful by default fixes

  eaidova

  committed
  2c3e934

• less agressive stateful

  eaidova

  committed
  27c0f0a

• ensure that task support stateful

  eaidova

  committed
  18caf84

Commits on Jan 12, 2024

• remove debug print

  eaidova

  committed
  b059a5f

• Apply suggestions from code review

  Show description for dd9f41d
  

  eaidova

  and

  slyalin

  authored
  dd9f41d

Commits on Jan 15, 2024

• Apply suggestions from code review

  Show description for 7006264
  

  eaidova

  and

  helena-intel

  authored
  7006264

• update requirements and warning messages

  eaidova

  committed
  2fb9032

• Apply suggestions from code review

  Show description for b5e87b2
  

  eaidova

  and

  echarlaix

  committed
  b5e87b2

• fix cli export

  eaidova

  committed
  a18d57c

Commits on Jan 16, 2024

• Update optimum/exporters/openvino/__main__.py

  Show description for f79b4f1
  

  eaidova

  and

  echarlaix

  authored
  f79b4f1