Update app-testing script

[davidmallasen]

TO-DO:

• Run the compilation flow with both gcc and clang
• Fix verilator flow
• Fix compiling of applications

[LuigiGiuffrida98]

Traceback (most recent call last): File ".github/workflows/test-apps/test_apps.py", line 466, in <module> main() File ".github/workflows/test-apps/test_apps.py", line 434, in main simulation_result = run_app(an_app, simulator) File ".github/workflows/test-apps/test_apps.py", line 172, in run_app run_output = subprocess.run( File "/opt/conda/envs/core-v-mini-mcu/lib/python3.8/subprocess.py", line 493, in run with Popen(*popenargs, **kwargs) as process: File "/opt/conda/envs/core-v-mini-mcu/lib/python3.8/subprocess.py", line 858, in __init__ self._execute_child(args, executable, preexec_fn, close_fds, File "/opt/conda/envs/core-v-mini-mcu/lib/python3.8/subprocess.py", line 1720, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: './Vtestharness'

The script tries to run the applications even if the verilator model did not compile correctly.

[LuigiGiuffrida98]

=================================
Results:

19 out of 33 apps finished successfully.
3 apps were skipped.
- example_spi_read
- example_spi_write
- example_spidma_powergate
11 apps failed to compile.
- example_dma_2d
- example_i2s
- example_dma_multichannel
- example_gpio_intr
- example_iffifo
- example_dma_external
- example_simple_accelerator
- example_power_manager
- example_sdk_spi_flash
- example_data_processing_from_flash
- example_ext_memory

[davidmallasen]

Traceback (most recent call last): File ".github/workflows/test-apps/test_apps.py", line 466, in <module> main() File ".github/workflows/test-apps/test_apps.py", line 434, in main simulation_result = run_app(an_app, simulator) File ".github/workflows/test-apps/test_apps.py", line 172, in run_app run_output = subprocess.run( File "/opt/conda/envs/core-v-mini-mcu/lib/python3.8/subprocess.py", line 493, in run with Popen(*popenargs, **kwargs) as process: File "/opt/conda/envs/core-v-mini-mcu/lib/python3.8/subprocess.py", line 858, in __init__ self._execute_child(args, executable, preexec_fn, close_fds, File "/opt/conda/envs/core-v-mini-mcu/lib/python3.8/subprocess.py", line 1720, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: './Vtestharness'

The script tries to run the applications even if the verilator model did not compile correctly.

That should not happen because of this:

x-heep/.github/workflows/test-apps/test_apps.py

Line 235 in 1467bec

exit(1)

I checked locally and it's failing from some verilator warnings. For some reason, the error exit code (which is different from 0) is not caught by the subprocess.CalledProcessError. We'll have to waive those warnings in verilator and check that the error message simulation_build_output does not contain any error.

[LuigiGiuffrida98]

🎉 Verilator 5 supports timing simulation, the spiflash model have been compiled with verilator. Getting closer to run all the examples in CI. 🎊

⚠️ At the current status, Verilator does not generate any lint warning, but the docker is missing some packages to compile the model.

⚠️ All the template files have been added as a dependency of a lock file generated with mcu-gen in order to regenerate the mcu everytime a tpl file is edited, the lockfile prevents the regeneration every time a target is run.