Pipeline

[jiqing-feng]

Hi @echarlaix . I just recognized that we didn't have any ipex optimization guide in README.

To make it more friendly to users, I integrated the generation modeling in our new pipeline. Users can just import pipeline from optimum-intel and easily apply optimum-intel optimization by only changing 1 line code from HF.

I think this approach is better than the old one, and it also aligns with optimum-nvidia

You can see that I simplified the pipeline as much as possible because we only need to consider text-generation for now. With this framework, it would be better to enable other tasks in the future.

Would you please help to review these changes? Thx!

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[jiqing-feng]

Hi @echarlaix
I have updated the pipeline design to try to align with the optimum. Please take a look and check if the design is correct. Once our design is done, we could discuss the tests : )

[jiqing-feng]

Hi @echarlaix . Would you please review my changes? Thx!

[IlyasMoutawwakil]

Hi! I left two comments about the usage of model_kwargs and hub_kwargs

[jiqing-feng]

Hi @IlyasMoutawwakil . Thanks for your review. Would you please check my new changes? Thx!

[jiqing-feng]

Hi @IlyasMoutawwakil . I think we could merge this PR since the failed CIs are not related to my changes

[echarlaix]

To fix the code style test you can do the following :

pip install .[quality]
make style

[jiqing-feng]

Hi @echarlaix . I have fixed all your comments except the model/graph check. Would you please review it? Thx!

[jiqing-feng]

Hi @echarlaix @IlyasMoutawwakil . Thanks for your review. I suppose we can merge it.