Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test generation sometimes fails by timeout for a random JavaScript example. #103

Open
alisevych opened this issue Oct 14, 2022 · 3 comments
Assignees
Labels
bug Something isn't working found_by_autotest Issue is found by test automation

Comments

@alisevych
Copy link
Member

alisevych commented Oct 14, 2022

Description

Test generation fails by timeout for a random JavaScript example - sometimes.
Happened once for Simple arithmetic and once for Recursion: Fibonacci - during a week.
Tests for other examples - at the same test run - were successfully generated.

To Reproduce

  1. Open https://www.utbot.org/utbot page
  2. Press Try it online button
  3. Select JavaScript
  4. Select Simple arithmetic example
  5. Press Generate and Run Tests

Expected behavior

Tests are supposed to be generated successfully.

Actual behavior

Sometimes:

TEST GENERATION: FAILED
TimeoutException

Visual proofs (screenshots, logs, images)

1665729588733 1

@alisevych alisevych added bug Something isn't working found_by_autotest Issue is found by test automation labels Oct 14, 2022
@alisevych
Copy link
Member Author

alisevych commented Oct 20, 2022

@victoriafomina
Reproduced with same screenshot/exception - now for while loop.
All other examples were processed correctly.

@alexeyfridman
Copy link
Collaborator

alexeyfridman commented Oct 26, 2022

Today:
TEST GENERATION: SUCCEEDED
in both examples

image

image

@alisevych
Copy link
Member Author

Reproduced again with JavaScript : Loop inside loop

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working found_by_autotest Issue is found by test automation
Projects
None yet
Development

No branches or pull requests

3 participants