Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Print properties of compile model #488

Merged

Conversation

wgzintel
Copy link
Contributor

@wgzintel wgzintel commented Dec 11, 2023

print properties of compiled model:

Compiling the model to CPU ...
CPU SUPPORTED_PROPERTIES:
NETWORK_NAME: Model0
OPTIMAL_NUMBER_OF_INFER_REQUESTS: 1
NUM_STREAMS: 1
AFFINITY: Affinity.CORE
INFERENCE_NUM_THREADS: 96
PERF_COUNT: NO
INFERENCE_PRECISION_HINT: <Type: 'bfloat16'>
PERFORMANCE_HINT: LATENCY
EXECUTION_MODE_HINT: ExecutionMode.PERFORMANCE
PERFORMANCE_HINT_NUM_REQUESTS: 0
ENABLE_CPU_PINNING: True
SCHEDULING_CORE_TYPE: SchedulingCoreType.ANY_CORE
ENABLE_HYPER_THREADING: False
EXECUTION_DEVICES: CPU
CPU_DENORMALS_OPTIMIZATION: False
CPU_SPARSE_WEIGHTS_DECOMPRESSION_RATE: 1.0

@helena-intel
Copy link
Collaborator

Thanks @wgzintel ! Could you run make style in the repo root to fix the code quality check? Install requirements for that with pip install .[quality]

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@wgzintel
Copy link
Contributor Author

wgzintel commented Dec 13, 2023

Thanks @wgzintel ! Could you run make style in the repo root to fix the code quality check? Install requirements for that with pip install .[quality]

Done @helena-intel

@wgzintel wgzintel changed the title print properties of compile model Print properties of compile model Dec 13, 2023
@helena-intel
Copy link
Collaborator

Thanks for this PR @wgzintel this is really useful. It would be great if you could add a simple test to https://github.com/huggingface/optimum-intel/blob/main/tests/openvino/test_modeling.py. Nothing complicated, just that the function to print properties is run in the tests so we are alerted if it breaks at some point.

@helena-intel helena-intel self-requested a review December 13, 2023 08:58
Copy link
Collaborator

@echarlaix echarlaix left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for the addition @wgzintel

@echarlaix echarlaix merged commit 17bf770 into huggingface:main Jan 4, 2024
PenghuiCheng pushed a commit to PenghuiCheng/optimum-intel that referenced this pull request Jan 16, 2024
* print properties of compile model

* Reference to benchmark_tool/openvino/tools/benchmark/main.py

* format code

* format code with ruff

* print properties of compile model of diffusion and seq2seq

* format code with ruff

* Update optimum/intel/openvino/utils.py

Co-authored-by: Ella Charlaix <[email protected]>

* Update optimum/intel/openvino/utils.py

Co-authored-by: Ella Charlaix <[email protected]>

* refine code

---------

Co-authored-by: Ella Charlaix <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants