Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[6.14.z] Test CV incremental update & publish time #14809

Conversation

Satellite-QE
Copy link
Collaborator

Cherrypick of PR: #14749

Problem Statement

Implement backlogged desired coverage - PR #9991 , authored by @latran

Solution

  • Automation for incremental update duration coverage, for BZ 2117760 and BZ 1829266

  • Steps:

    • On an existing CV with decent amount of content, perform incremental update with only one errata.
    • Publish the entire content view.
    • Expect: The duration of the incremental update should almost always be shorter than the CV publish. To cover the BZs fully, if the update does take longer, check that it was close, that update did not take significantly longer.
  • Original issue raised in BZs: CV publish would only take a few minutes as expected, but incremental update with one or a couple errata was taking over an hour.

  • timeout (to catch any future performance degradation) - for incr. update is 20 seconds,
    for publish of CV timeout is 30 seconds, based on prt performance.
    Includes logging duration for both incr. update and cv publish.

PRT case

trigger: test-robottelo
pytest: tests/foreman/longrun/test_inc_updates.py::test_positive_incremental_update_time

Test incremental update time

(cherry picked from commit 11858fa)
@Satellite-QE Satellite-QE added 6.14.z Introduced in or relating directly to Satellite 6.14 Auto_Cherry_Picked Automatically cherrypicked PR using GHA No-CherryPick PR doesnt need CherryPick to previous branches labels Apr 17, 2024
@Satellite-QE
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/longrun/test_inc_updates.py::test_positive_incremental_update_time

@Satellite-QE
Copy link
Collaborator Author

PRT Result

Build Number: 6567
Build Status: SUCCESS
PRT Comment: pytest tests/foreman/longrun/test_inc_updates.py::test_positive_incremental_update_time --external-logging
Test Result : ================= 1 passed, 14 warnings in 1020.55s (0:17:00) ==================

@Satellite-QE Satellite-QE added the PRT-Passed Indicates that latest PRT run is passed for the PR label Apr 17, 2024
@damoore044 damoore044 added the AutoMerge_Cherry_Picked The cherrypicked PRs of master PR would be automerged if all checks passing label Apr 17, 2024
@Satellite-QE Satellite-QE merged commit b2a0627 into 6.14.z Apr 17, 2024
18 checks passed
@Satellite-QE Satellite-QE deleted the cherry-pick-6.14.z-11858fa660cf3528617f0d69837f139732a01517 branch April 17, 2024 13:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
6.14.z Introduced in or relating directly to Satellite 6.14 Auto_Cherry_Picked Automatically cherrypicked PR using GHA AutoMerge_Cherry_Picked The cherrypicked PRs of master PR would be automerged if all checks passing No-CherryPick PR doesnt need CherryPick to previous branches PRT-Passed Indicates that latest PRT run is passed for the PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants