Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable SV-COMP syntactic loop unrolling #1402

Closed
wants to merge 2 commits into from
Closed

Conversation

sim642
Copy link
Member

@sim642 sim642 commented Apr 2, 2024

This is cherry-picked from #1372 in preparation for it to get merged: #1372 (comment).

I benchmarked the equivalent change at be3ee1d: https://goblint.cs.ut.ee/results/158-rm-loop-unroll-after/table-generator-cmp.diff.html. This costs us ~100 tasks, mostly from nla-digbench-scaling/_unwindbound and product-lines/elevator_spec.
The actual delta is that we lose ~130 true verdicts, but also gain ~30 true verdicts (from cases where unrolling causes excessive resource usage).
The nightly BenchExec run will give a more up-to-date comparison, but I don't expect it to be different since nothing notable has been changed in SV-COMP analyses in this time.

To get this back, we'll have to finalize #1370 for SV-COMP 2025.

@sim642 sim642 added sv-comp SV-COMP (analyses, results), witnesses precision labels Apr 2, 2024
@sim642 sim642 added this to the SV-COMP 2025 milestone Apr 2, 2024
@sim642 sim642 requested a review from michael-schwarz April 2, 2024 07:50
@michael-schwarz
Copy link
Member

To get this back, we'll have to finalize #1370 for SV-COMP 2025.

This is under the assumption that the same behavior can be achieved there, which is not a given, e.g., vis-a-vis automatic detection of widening points or the termination analysis.

@sim642
Copy link
Member Author

sim642 commented Apr 4, 2024

Closing since #1403 made it redundant for #1372.

@sim642 sim642 closed this Apr 4, 2024
@sim642 sim642 removed this from the SV-COMP 2025 milestone Apr 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
precision sv-comp SV-COMP (analyses, results), witnesses
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants