Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[6.14.z] Capsule N-Minus testing #14343

Conversation

Satellite-QE
Copy link
Collaborator

Cherrypick of PR: #12939

Changes include:

  • A new pytest plugin for Capsule N-minus testing that would smart collect all capsule specific tests excluding few.
    • New option of --n-minus for collecting only capsule specific tests
    • tests using the caspule_factory are collected
    • destructive, maintain and puppet tests are excluded since they need a separate satellite
  • Introduces new setting hostname in capsule conf to take capsule hostname given from CI.
  • _target_capsule_host context manager now returns the cached capsule taken from CI instead of spinning of new capsule for everytime.
  • The CI capsule is registered once/cached to CDN for RHEL contents needed by some tests at the start of the n-minus testing and would be unregistered at the end of test session.
  • Since we are using single capsule already integrated with satellite in CI, we are escaping the capsule setup from fixtures for n-minus testing
  • Some test amendments for nminus testing.

(cherry picked from commit 6426265)
@Satellite-QE Satellite-QE added 6.14.z Introduced in or relating directly to Satellite 6.14 Auto_Cherry_Picked Automatically cherrypicked PR using GHA No-CherryPick PR doesnt need CherryPick to previous branches labels Mar 11, 2024
@Satellite-QE
Copy link
Collaborator Author

trigger: test-robottelo
pytest: --uses-fixtures capsule_factory tests/foreman/api
provisioning: true
env:
    ROBOTTELO_server__deploy_arguments__deploy_sat_version: '6.15.0'
    ROBOTTELO_server__deploy_arguments__deploy_snap_version: ''
    ROBOTTELO_server__version__release: '6.15.0'
    ROBOTTELO_server__version__snap: ''

@Satellite-QE
Copy link
Collaborator Author

PRT Result

Build Number: 6017
Build Status: UNSTABLE
PRT Comment: pytest --uses-fixtures capsule_factory tests/foreman/api --external-logging --include-onprem-provisioning
Test Result : = 3 failed, 18 passed, 7 skipped, 2761 deselected, 1731 warnings, 8 errors in 8924.63s (2:28:44) =

@Satellite-QE Satellite-QE added the PRT-Failed Indicates that latest PRT run is failed for the PR label Mar 11, 2024
@jyejare
Copy link
Member

jyejare commented Mar 12, 2024

trigger: test-robottelo
pytest: --uses-fixtures capsule_factory tests/foreman/api
provisioning: true
env:
    ROBOTTELO_server__deploy_arguments__deploy_sat_version: '6.14.3'
    ROBOTTELO_server__deploy_arguments__deploy_snap_version: ''
    ROBOTTELO_server__version__release: '6.14.3'
    ROBOTTELO_server__version__snap: ''

@Gauravtalreja1 Gauravtalreja1 merged commit a042923 into 6.14.z Mar 12, 2024
21 of 22 checks passed
@Gauravtalreja1 Gauravtalreja1 deleted the cherry-pick-6.14.z-64262657ea61aeb20f174ed67d466c8fbcee8ffa branch March 12, 2024 13:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
6.14.z Introduced in or relating directly to Satellite 6.14 Auto_Cherry_Picked Automatically cherrypicked PR using GHA No-CherryPick PR doesnt need CherryPick to previous branches PRT-Failed Indicates that latest PRT run is failed for the PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants