Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix(test): have codecov uploader exit with non-zero code on error #5016

Merged
merged 1 commit into from
Jan 28, 2025

Conversation

roypat
Copy link
Contributor

@roypat roypat commented Jan 28, 2025

Pass the -Z flag (fail on error) to the codecov uploader. According to
the docs, without this flag upload failures will be silently ignored
(why isn't this the default??) 1. We can also see this from the logs,
which contain:

[2025-01-28T12:10:57.973Z] ['info'] Codecov will exit with status code
0. If you are expecting a non-zero exit code, please pass in the `-Z`
flag

The docs say that a long form --fail-on-error is available, but actually
it doesnt seem to work, so we have to use -Z.

example of it failing: https://buildkite.com/firecracker/firecracker-pr/builds/12416#0194ad35-9532-409d-b90b-1a05c3f80cc1

Changes

...

Reason

...

License Acceptance

By submitting this pull request, I confirm that my contribution is made under
the terms of the Apache 2.0 license. For more information on following Developer
Certificate of Origin and signing off your commits, please check
CONTRIBUTING.md.

PR Checklist

  • I have read and understand CONTRIBUTING.md.
  • I have run tools/devtool checkstyle to verify that the PR passes the
    automated style checks.
  • I have described what is done in these changes, why they are needed, and
    how they are solving the problem in a clear and encompassing way.
  • I have updated any relevant documentation (both in code and in the docs)
    in the PR.
  • I have mentioned all user-facing changes in CHANGELOG.md.
  • If a specific issue led to this PR, this PR closes the issue.
  • When making API changes, I have followed the
    Runbook for Firecracker API changes.
  • I have tested all new and changed functionalities in unit tests and/or
    integration tests.
  • I have linked an issue to every new TODO.

  • This functionality cannot be added in rust-vmm.

@roypat roypat force-pushed the fix-codecov branch 4 times, most recently from bb801d6 to 0c80913 Compare January 28, 2025 13:57
@roypat roypat changed the title fix(test): actually specify codecov token when uploading coverage Fix(test): have codecov uploader exit with non-zero code on error Jan 28, 2025
Pass the `-Z` flag (fail on error) to the codecov uploader. According to
the docs, without this flag upload failures will be silently ignored
(why isn't this the default??) [1]. We can also see this from the logs,
which contain:

```
[2025-01-28T12:10:57.973Z] ['info'] Codecov will exit with status
code
0. If you are expecting a non-zero exit code, please pass in the `-Z`
flag
```

The docs say that a long form `--fail-on-error` is available, but
actually it doesnt seem to work, so we have to use `-Z`.

[1]: https://docs.codecov.com/docs/cli-options

Signed-off-by: Patrick Roy <[email protected]>
@roypat roypat marked this pull request as ready for review January 28, 2025 14:07
@roypat roypat added the Status: Awaiting review Indicates that a pull request is ready to be reviewed label Jan 28, 2025
Copy link

codecov bot commented Jan 28, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 83.13%. Comparing base (88e0b6e) to head (7381066).
Report is 2 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #5016   +/-   ##
=======================================
  Coverage   83.13%   83.13%           
=======================================
  Files         245      245           
  Lines       26697    26697           
=======================================
  Hits        22194    22194           
  Misses       4503     4503           
Flag Coverage Δ
5.10-c5n.metal 83.60% <ø> (?)
5.10-m5n.metal 83.58% <ø> (+<0.01%) ⬆️
5.10-m6a.metal 82.79% <ø> (-0.01%) ⬇️
5.10-m6g.metal 79.56% <ø> (ø)
5.10-m6i.metal 83.57% <ø> (ø)
5.10-m7g.metal 79.56% <ø> (ø)
6.1-c5n.metal 83.59% <ø> (-0.01%) ⬇️
6.1-m5n.metal 83.58% <ø> (ø)
6.1-m6a.metal 82.80% <ø> (+<0.01%) ⬆️
6.1-m6g.metal 79.56% <ø> (ø)
6.1-m6i.metal 83.57% <ø> (ø)
6.1-m7g.metal 79.56% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@roypat roypat merged commit 0d2713b into firecracker-microvm:main Jan 28, 2025
7 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: Awaiting review Indicates that a pull request is ready to be reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants