Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: boards: nrf: coresight_stm: Add performance test for STM #79000

Merged

Conversation

nordic-segl
Copy link
Contributor

@nordic-segl nordic-segl commented Sep 25, 2024

Extend STM testing with verification whether STM benchmark results are below predefined thresholds.
Set thresholds arbitrarily.

Add tests that allow code coverage calculation.

@nordic-segl nordic-segl force-pushed the NRFX-6024_Add-STM-regression-test branch from 8a37cee to 0a42cc8 Compare September 26, 2024 12:11
@nordic-segl nordic-segl force-pushed the NRFX-6024_Add-STM-regression-test branch from 0a42cc8 to 1c5a065 Compare October 11, 2024 10:39
@zephyrbot zephyrbot added area: Samples Samples platform: nRF Nordic nRFx labels Oct 11, 2024
nordic-segl added a commit to nordic-segl/sdk-zephyr that referenced this pull request Oct 11, 2024
…t for STM

Extend STM testing with verification whether STM benchmark
results are below predefined thresholds.
Set thresholds arbitrarily.

Add tests that allow code coverage calculation.

Upstream PR: zephyrproject-rtos/zephyr#79000

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Oct 11, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-zephyr that referenced this pull request Oct 14, 2024
…t for STM

Extend STM testing with verification whether STM benchmark
results are below predefined thresholds.
Set thresholds arbitrarily.

Add tests that allow code coverage calculation.

Upstream PR: zephyrproject-rtos/zephyr#79000

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Oct 14, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-zephyr that referenced this pull request Oct 17, 2024
…t for STM

Extend STM testing with verification whether STM benchmark
results are below predefined thresholds.
Set thresholds arbitrarily.

Add tests that allow code coverage calculation.

Upstream PR: zephyrproject-rtos/zephyr#79000

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Oct 17, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-krch
nordic-krch previously approved these changes Oct 17, 2024
nordic-segl added a commit to nordic-segl/sdk-zephyr that referenced this pull request Oct 17, 2024
…t for STM

Extend STM testing with verification whether STM benchmark
results are below predefined thresholds.
Set thresholds arbitrarily.

Add tests that allow code coverage calculation.

Upstream PR: zephyrproject-rtos/zephyr#79000

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Oct 17, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-zephyr that referenced this pull request Oct 18, 2024
…t for STM

Extend STM testing with verification whether STM benchmark
results are below predefined thresholds.
Set thresholds arbitrarily.

Add tests that allow code coverage calculation.

Upstream PR: zephyrproject-rtos/zephyr#79000

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Oct 18, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
@anangl anangl assigned nordic-krch and unassigned anangl Oct 18, 2024
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 6, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
@nordic-segl
Copy link
Contributor Author

nordic-segl commented Dec 6, 2024

Rebased, please do review.

nordic-krch
nordic-krch previously approved these changes Dec 9, 2024
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 10, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
@nordic-segl nordic-segl force-pushed the NRFX-6024_Add-STM-regression-test branch from a08e7ba to 7bd44e0 Compare December 10, 2024 12:57
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 10, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
@nordic-segl nordic-segl force-pushed the NRFX-6024_Add-STM-regression-test branch from 7bd44e0 to 72d3b5f Compare December 11, 2024 07:50
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 11, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-krch
nordic-krch previously approved these changes Dec 11, 2024
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 11, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 11, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
Comment on lines +11 to +13
if(NOT (CONFIG_BOARD_NRF54H20DK_NRF54H20_CPUAPP))
message(FATAL_ERROR "${BOARD}${BOARD_QUALIFIERS} is not supported for this sample")
endif()
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is already specified in testcase.yaml so seems redundant.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

testcase.yaml is parsed by Twister only. This check is valid for both Twister and manual west build.

SB_CONFIG_APP_CPUPPR_RUN = None
SB_CONFIG_APP_CPUFLPR_RUN = None

# https://github.com/zephyrproject-rtos/zephyr/blob/main/drivers/misc/coresight/nrf_etr.c#L102
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suppose this is more about lines 99 and 101.
Perhaps using hex values below would be clearer as well.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"I suppose this is more about lines 99 and 101." - there were changes to the nrf_etr.c in mean time which made this comment misleading. Maybe See definition of stm_m_id[] and stm_m_name[] in https://github.com/zephyrproject-rtos/zephyr/blob/main/drivers/misc/coresight/nrf_etr.c would be better.

Decimal values must be used with nrfutil trace --database-config XX:path_to_json,YY:path_to_json,ZZ:path_to_json.
I wanted to demonstrate how to map coprocessor into --database-config string rather than where these values come from.

tests/boards/nrf/coresight_stm/pytest/test_stm.py Outdated Show resolved Hide resolved
@nordic-segl nordic-segl force-pushed the NRFX-6024_Add-STM-regression-test branch 2 times, most recently from fdcd156 to 26c6574 Compare December 11, 2024 14:03
Extend STM testing with verification whether STM benchmark
results are below predefined thresholds.
Set thresholds arbitrarily.

Add tests that allow code coverage calculation.

Signed-off-by: Sebastian Głąb <[email protected]>
@nordic-segl nordic-segl force-pushed the NRFX-6024_Add-STM-regression-test branch from 26c6574 to a57c64e Compare December 11, 2024 14:08
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 11, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 13, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 13, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 13, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 16, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
@kartben kartben merged commit 29208fe into zephyrproject-rtos:main Dec 16, 2024
18 checks passed
@nordic-segl nordic-segl deleted the NRFX-6024_Add-STM-regression-test branch December 16, 2024 07:45
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 16, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
nordic-segl added a commit to nordic-segl/sdk-nrf that referenced this pull request Dec 16, 2024
tests: boards: nrf: coresight_stm: Add performance test for STM
zephyrproject-rtos/zephyr#79000
nrfconnect/sdk-zephyr#2097

Signed-off-by: Sebastian Głąb <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants