Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI_for_Specimin #351

Merged
merged 38 commits into from
Aug 9, 2024
Merged

CI_for_Specimin #351

merged 38 commits into from
Aug 9, 2024

Conversation

NiharikaJamble
Copy link
Collaborator

This CI evaluates accuracy of specimin for any push/pull events on main.
It will check file CI_Latest_run_percentage.txt for the latest accuracy percentage of specimin.

The CI will pass if the current accuracy( accuracy calculated for current change) matches the existing accuracy of main branch, if not the CI will result in failure.

In case the calculated accuracy doesn't match, and is higher than the value present in the file, it needs to be manually updated to the txt file.

Copy link
Collaborator

@kelloggm kelloggm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Other than the name, this looks good to me.

@@ -0,0 +1,132 @@
name: specimin_evaluation_CI
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we change the name of this job to be more descriptive of what it actually does? Maybe something like "check_compilable_percentage"?

There is already another CI job called "specimin-evaluation", so I'm trying to avoid confusion.

@NiharikaJamble
Copy link
Collaborator Author

NiharikaJamble commented Aug 8, 2024 via email

@kelloggm
Copy link
Collaborator

kelloggm commented Aug 9, 2024

@NiharikaJamble the .txt file that you added with the accuracy isn't correct - see the job's failure. This is good validation that this is working as expected; once you update that file to be correct and CI passes, this will merge.

@kelloggm kelloggm merged commit 0201a94 into njit-jerse:main Aug 9, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants