Add OpenVINO export CLI

[echarlaix]

example :

optimum-cli export openvino --model distilbert-base-uncased-finetuned-sst-2-english distilbert_openvino

It could also make sense to add weight only quantization in a following PR, what do you think ? @helena-intel @AlexKoff88

[HuggingFaceDocBuilderDev]

The documentation is not available anymore as the PR was closed or merged.

[helena-intel]

Thanks @echarlaix I love this! I also really like that it exports the tokenizer too. Agreed that weight compression for CausalLM models would be great to add too. It would also be good to have an FP16 option. We could also consider to export to FP16 by default. This is what OpenVINO now does by default too when you convert/save a model, with an option to disable it.

The example worked without errors, but it exported the distilbert model as model.xml and .bin instead of openvino_model.xml and bin. And for gpt2 it exported decoder_model.xml/bin and decoder_model_with_past xml/bin.

[echarlaix]

Thanks @echarlaix I love this! I also really like that it exports the tokenizer too. Agreed that weight compression for CausalLM models would be great to add too. It would also be good to have an FP16 option. We could also consider to export to FP16 by default. This is what OpenVINO now does by default too when you convert/save a model, with an option to disable it.

Yes it would be good to have the FP16 support directly in the CLI as well I agree!

The example worked without errors, but it exported the distilbert model as model.xml and .bin instead of openvino_model.xml and bin. And for gpt2 it exported decoder_model.xml/bin and decoder_model_with_past xml/bin.

Yes, I also realized this and added the fix in main_export in #439. Thanks a lot for finding + reporting it!

[AlexKoff88]

example :

optimum-cli export openvino --model distilbert-base-uncased-finetuned-sst-2-english distilbert_openvino

It could also make sense to add weight only quantization in a following PR, what do you think ? @helena-intel @AlexKoff88

It totally makes sense.