-
Notifications
You must be signed in to change notification settings - Fork 115
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update sharing memory flags for OpenVINO #429
Conversation
Hi, @echarlaix this PR should go together with OpenVINO 2023.1 (now only pre-release versions are available: https://pypi.org/project/openvino/#history). Will the newest version update trigger automatically when OpenVINO drops? (ofc I will trigger branch update) |
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. |
I think we should also update the quantization part where the infer request is wrapped. Here, we should only use |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks @jiwaszki !
@jiwaszki, can you please rebase? |
done in #499 |
Update deprecated
shared_memory
flag with newshare_inputs
which works in the same way. Removes warnings.Added new flag
share_outputs
to utilize new feature of OpenVINO to reduce copies to minimum.