Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Indicate changes in bot evaluated results #1280

Open
howard-e opened this issue Nov 21, 2024 · 0 comments
Open

Indicate changes in bot evaluated results #1280

howard-e opened this issue Nov 21, 2024 · 0 comments

Comments

@howard-e
Copy link
Contributor

When #1279 lands, it will now create a unique but likely scenario where there is a combination of bot produced and manual-tester produced results for test(s) in a test run, which will give no clear indication of which AT or Browser Version actually produced the results shown for the commands' outputs.

To maintain the version related accuracy of finalized results, should we:

  1. Highlight that there is now a difference in AT or Browser versions than what was originally ran by the bot?
  2. Should the same be extended to highlighting a difference in the output content produced by the bot if that evaluated result is also altered?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant