Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Device with "(CPU)" name is not registered when using "AUTO" and setting OPENVINO_LOG_LEVEL=5 #28866

Conversation

wgzintel
Copy link
Contributor

@wgzintel wgzintel commented Feb 7, 2025

Details:

setting OPENVINO_LOG_LEVEL=5
ov_genai.VLMPipeline(model_path, "AUTO") will have error as below:

failed Exception from src\inference\src\cpp\core.cpp:223:
Exception from src\inference\src\dev\core_impl.cpp:609:
Device with "(CPU)" name is not registered in the OpenVINO Runtime

In latency mode, AUTO will use the CPU for acceleration, and the execution device name will be changed to (CPU)

Tickets:

CVS-160732

@wgzintel wgzintel requested a review from a team as a code owner February 7, 2025 04:24
@github-actions github-actions bot added the category: inference OpenVINO Runtime library - Inference label Feb 7, 2025
@ilya-lavrenov
Copy link
Contributor

at what place we call OV API with such device name?

@wgzintel
Copy link
Contributor Author

wgzintel commented Feb 8, 2025

at what place we call OV API with such device name?
From GenAI API for printing properties of compiled model when setting OPENVINO_LOG_LEVEL=5
https://github.com/openvinotoolkit/openvino.genai/blob/1bdd4f94a4bb610b84f5c28e504c8df7cc332d30/src/cpp/src/utils.cpp#L397

@@ -580,6 +580,8 @@ ov::Plugin ov::CoreImpl::get_plugin(const std::string& pluginName) const {
auto deviceName = pluginName;
if (deviceName == ov::DEFAULT_DEVICE_NAME)
deviceName = "AUTO";
if (deviceName == "(CPU)")
deviceName = "CPU";
Copy link
Contributor

@ilya-lavrenov ilya-lavrenov Feb 8, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need the same for other devices? Like (GPU) etc

could you please remind in what case we have () around device name?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Currently only the CPU has this alias(CPU). When the CPU is used as an acceleration.

@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Feb 8, 2025
@ilya-lavrenov ilya-lavrenov added this to the 2025.1 milestone Feb 8, 2025
@ilya-lavrenov ilya-lavrenov self-assigned this Feb 8, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Feb 8, 2025
@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Feb 8, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Feb 8, 2025
@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Feb 9, 2025
Merged via the queue into openvinotoolkit:master with commit c04d828 Feb 9, 2025
185 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: inference OpenVINO Runtime library - Inference
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants