Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[6.15.z] Capsule N-Minus testing #14344

Merged

Conversation

Satellite-QE
Copy link
Collaborator

Cherrypick of PR: #12939

Changes include:

  • A new pytest plugin for Capsule N-minus testing that would smart collect all capsule specific tests excluding few.
    • New option of --n-minus for collecting only capsule specific tests
    • tests using the caspule_factory are collected
    • destructive, maintain and puppet tests are excluded since they need a separate satellite
  • Introduces new setting hostname in capsule conf to take capsule hostname given from CI.
  • _target_capsule_host context manager now returns the cached capsule taken from CI instead of spinning of new capsule for everytime.
  • The CI capsule is registered once/cached to CDN for RHEL contents needed by some tests at the start of the n-minus testing and would be unregistered at the end of test session.
  • Since we are using single capsule already integrated with satellite in CI, we are escaping the capsule setup from fixtures for n-minus testing
  • Some test amendments for nminus testing.

@Satellite-QE Satellite-QE added the 6.15.z Introduced in or relating directly to Satellite 6.15 label Mar 11, 2024
@Satellite-QE Satellite-QE requested a review from a team as a code owner March 11, 2024 12:56
@Satellite-QE Satellite-QE added Auto_Cherry_Picked Automatically cherrypicked PR using GHA No-CherryPick PR doesnt need CherryPick to previous branches labels Mar 11, 2024
@Satellite-QE Satellite-QE requested a review from a team as a code owner March 11, 2024 12:56
@Satellite-QE
Copy link
Collaborator Author

trigger: test-robottelo
pytest: --uses-fixtures capsule_factory tests/foreman/api
provisioning: true
env:
    ROBOTTELO_server__deploy_arguments__deploy_sat_version: '6.15.0'
    ROBOTTELO_server__deploy_arguments__deploy_snap_version: ''
    ROBOTTELO_server__version__release: '6.15.0'
    ROBOTTELO_server__version__snap: ''

@Satellite-QE
Copy link
Collaborator Author

PRT Result

Build Number: 6016
Build Status: UNSTABLE
PRT Comment: pytest --uses-fixtures capsule_factory tests/foreman/api --external-logging --include-onprem-provisioning
Test Result : = 3 failed, 27 passed, 7 skipped, 2765 deselected, 2621 warnings, 2 errors in 13337.90s (3:42:17) =

@Satellite-QE Satellite-QE added the PRT-Failed Indicates that latest PRT run is failed for the PR label Mar 11, 2024
@jyejare
Copy link
Member

jyejare commented Mar 12, 2024

The test failures here are not related to the framework changes and same as master PR. Hence we should be good to merge it !

Merging it as we Caspule NMinus pipelines merged and will be triggered sooner !!

@jyejare jyejare added PRT-Passed Indicates that latest PRT run is passed for the PR and removed PRT-Failed Indicates that latest PRT run is failed for the PR labels Mar 12, 2024
(cherry picked from commit 6426265)
@jyejare jyejare force-pushed the cherry-pick-6.15.z-64262657ea61aeb20f174ed67d466c8fbcee8ffa branch from 2c5cb12 to e7a6bb8 Compare March 12, 2024 08:43
@jyejare jyejare merged commit 9626ab6 into 6.15.z Mar 12, 2024
6 checks passed
@jyejare jyejare deleted the cherry-pick-6.15.z-64262657ea61aeb20f174ed67d466c8fbcee8ffa branch March 12, 2024 08:43
@Satellite-QE Satellite-QE removed the PRT-Passed Indicates that latest PRT run is passed for the PR label Mar 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
6.15.z Introduced in or relating directly to Satellite 6.15 Auto_Cherry_Picked Automatically cherrypicked PR using GHA No-CherryPick PR doesnt need CherryPick to previous branches
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants