Skip to content

(Single-card) Device perf regressions #5064

(Single-card) Device perf regressions

(Single-card) Device perf regressions #5064

Manually triggered February 26, 2025 11:36
Status Failure
Total duration 1h 59m 36s
Artifacts 3

perf-device-models.yaml

on: workflow_dispatch
build-artifact-profiler  /  ...  /  check-docker-images
8s
build-artifact-profiler / build-docker-image / check-docker-images
build-artifact-profiler  /  ...  /  🐳️ Build image
0s
build-artifact-profiler / build-docker-image / 🐳️ Build image
build-artifact-profiler  /  🛠️ Build Release ubuntu 20.04
6m 27s
build-artifact-profiler / 🛠️ Build Release ubuntu 20.04
Matrix: device-perf / device-perf
Fit to window
Zoom out
Zoom in

Annotations

3 errors, 10 warnings, and 5 notices
device-perf / N300 WH B0 device perf
Process completed with exit code 2.
device-perf / N300 WH B0 device perf: models/demos/wormhole/bert_tiny/tests/test_performance.py#L141
test_perf_device_bare_metal[16-6600] AssertionError: Some performance metrics are outside of expected range, see above for details.
device-perf / N300 WH B0 device perf
Process completed with exit code 1.
device-perf / N300 WH B0 device perf: models/demos/wormhole/stable_diffusion/tests/test_unet_2d_condition_model.py#L63
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
device-perf / N300 WH B0 device perf: usr/local/lib/python3.8/dist-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
device-perf / N300 WH B0 device perf: work/models/demos/wormhole/stable_diffusion/custom_preprocessing.py#L32
The use of `x.T` on tensors of dimension other than 2 to reverse their shape is deprecated and it will throw an error in a future release. Consider `x.mT` to transpose batches of matrices or `x.permute(*torch.arange(x.ndim - 1, -1, -1))` to reverse the dimensions of a tensor. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3637.)
device-perf / N300 WH B0 device perf: models/demos/wormhole/stable_diffusion/tests/test_perf.py#L206
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
device-perf / N300 WH B0 device perf: work/tt_metal/tools/profiler/process_model_log.py#L26
Columns (39,40,41,46,47,48,53,54,55,67,68,69,74,75,76) have mixed types. Specify dtype option on import or set low_memory=False.
device-perf / N300 WH B0 device perf: tests/ttnn/integration_tests/distilbert/test_ttnn_distilbert.py#L20
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
device-perf / N300 WH B0 device perf: usr/local/lib/python3.8/dist-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
device-perf / N300 WH B0 device perf: models/demos/distilbert/tests/test_perf_distilbert.py#L143
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
device-perf / N300 WH B0 device perf: tests/ttnn/integration_tests/vgg/test_ttnn_vgg11.py#L27
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
device-perf / N300 WH B0 device perf: tests/ttnn/integration_tests/vgg/test_ttnn_vgg16.py#L27
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
disk-usage-after-startup
Disk usage is 62 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.

Artifacts

Produced during runtime
Name Size
TTMetal_build_any_profiler
191 MB
eager-dist-ubuntu-20.04-any-profiler
341 MB
packages-ubuntu-20.04-amd64-Release-x86_64-linux-clang-17-libcpp_profiler
89.4 MB