Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

jenkins-job-builder: fix build #363535

Closed
wants to merge 4 commits into from

Conversation

bjornfor
Copy link
Contributor

@bjornfor bjornfor commented Dec 9, 2024

Things done

Fix building/running jenkins-job-builder and make nixosTests.jenkins pass.

Commits:

  • python3Packages.openstackdocstheme: add missing 'distutils' dependency
  • nixos/tests/jenkins: increase disk size to 2 GiB
  • python3Packages.jenkins-job-builder: add missing runtime dependency 'packaging'
  • python3Packages.jenkins-job-builder: add passthru.tests

Fixes #362054.

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

Fixes the build. And transitively fixes building jenkins-job-builder.
Or else Jenkins stops the built-in node due to lack of disk space (when
using the default 1 GiB).
@bjornfor
Copy link
Contributor Author

bjornfor commented Dec 9, 2024

Result of nixpkgs-review pr 363535 run on x86_64-linux 1

4 packages marked as broken and skipped:
  • python311Packages.subunit2sql
  • python311Packages.subunit2sql.dist
  • python312Packages.subunit2sql
  • python312Packages.subunit2sql.dist
14 packages failed to build:
  • python312Packages.python-cinderclient
  • python312Packages.python-cinderclient.dist
  • python312Packages.python-magnumclient
  • python312Packages.python-magnumclient.dist
  • python312Packages.python-neutronclient
  • python312Packages.python-neutronclient.dist
  • python312Packages.python-octaviaclient
  • python312Packages.python-octaviaclient.dist
  • python312Packages.python-openstackclient
  • python312Packages.python-openstackclient.dist
  • python312Packages.python-troveclient
  • python312Packages.python-troveclient.dist
  • python312Packages.swift
  • python312Packages.swift.dist
170 packages built:
  • barbicanclient (python311Packages.python-barbicanclient)
  • barbicanclient.dist (python311Packages.python-barbicanclient.dist)
  • bashate
  • bashate.dist
  • glanceclient (python311Packages.python-glanceclient)
  • glanceclient.dist (python311Packages.python-glanceclient.dist)
  • heatclient (python311Packages.python-heatclient)
  • heatclient.dist (python311Packages.python-heatclient.dist)
  • html5validator
  • html5validator.dist
  • ironicclient (python311Packages.python-ironicclient)
  • ironicclient.dist (python311Packages.python-ironicclient.dist)
  • jenkins-job-builder (python312Packages.jenkins-job-builder)
  • jenkins-job-builder.dist (python312Packages.jenkins-job-builder.dist)
  • kolla
  • kolla.dist
  • magnumclient (python311Packages.python-magnumclient)
  • magnumclient.dist (python311Packages.python-magnumclient.dist)
  • manilaclient (python311Packages.python-manilaclient)
  • manilaclient.dist (python311Packages.python-manilaclient.dist)
  • mistralclient (python311Packages.python-mistralclient)
  • mistralclient.dist (python311Packages.python-mistralclient.dist)
  • openstackclient (python311Packages.python-openstackclient)
  • openstackclient-full
  • openstackclient-full.dist
  • openstackclient.dist (python311Packages.python-openstackclient.dist)
  • python311Packages.cliff
  • python311Packages.cliff.dist
  • python311Packages.debtcollector
  • python311Packages.debtcollector.dist
  • python311Packages.hacking
  • python311Packages.hacking.dist
  • python311Packages.jenkins-job-builder
  • python311Packages.jenkins-job-builder.dist
  • python311Packages.keystoneauth1
  • python311Packages.keystoneauth1.dist
  • python311Packages.openstackdocstheme
  • python311Packages.openstackdocstheme.dist
  • python311Packages.openstacksdk
  • python311Packages.openstacksdk.dist
  • python311Packages.openstacksdk.man
  • python311Packages.os-client-config
  • python311Packages.os-client-config.dist
  • python311Packages.osc-lib
  • python311Packages.osc-lib.dist
  • python311Packages.osc-placement
  • python311Packages.osc-placement.dist
  • python311Packages.oslo-concurrency
  • python311Packages.oslo-concurrency.dist
  • python311Packages.oslo-config
  • python311Packages.oslo-config.dist
  • python311Packages.oslo-context
  • python311Packages.oslo-context.dist
  • python311Packages.oslo-db
  • python311Packages.oslo-db.dist
  • python311Packages.oslo-i18n
  • python311Packages.oslo-i18n.dist
  • python311Packages.oslo-log
  • python311Packages.oslo-log.dist
  • python311Packages.oslo-serialization
  • python311Packages.oslo-serialization.dist
  • python311Packages.oslo-utils
  • python311Packages.oslo-utils.dist
  • python311Packages.osprofiler
  • python311Packages.osprofiler.dist
  • python311Packages.python-aodhclient
  • python311Packages.python-aodhclient.dist
  • python311Packages.python-cinderclient
  • python311Packages.python-cinderclient.dist
  • python311Packages.python-designateclient
  • python311Packages.python-designateclient.dist
  • python311Packages.python-jenkins
  • python311Packages.python-jenkins.dist
  • python311Packages.python-keystoneclient
  • python311Packages.python-keystoneclient.dist
  • python311Packages.python-neutronclient
  • python311Packages.python-neutronclient.dist
  • python311Packages.python-novaclient
  • python311Packages.python-novaclient.dist
  • python311Packages.python-octaviaclient
  • python311Packages.python-octaviaclient.dist
  • swiftclient (python311Packages.python-swiftclient)
  • swiftclient.dist (python311Packages.python-swiftclient.dist)
  • troveclient (python311Packages.python-troveclient)
  • troveclient.dist (python311Packages.python-troveclient.dist)
  • watcherclient (python311Packages.python-watcherclient)
  • watcherclient.dist (python311Packages.python-watcherclient.dist)
  • python311Packages.python-zaqarclient
  • python311Packages.python-zaqarclient.dist
  • zunclient (python311Packages.python-zunclient)
  • zunclient.dist (python311Packages.python-zunclient.dist)
  • python311Packages.stestr
  • python311Packages.stestr.dist
  • python311Packages.swift
  • python311Packages.swift.dist
  • python311Packages.tempest
  • python311Packages.tempest.dist
  • python312Packages.cliff
  • python312Packages.cliff.dist
  • python312Packages.debtcollector
  • python312Packages.debtcollector.dist
  • python312Packages.hacking
  • python312Packages.hacking.dist
  • python312Packages.keystoneauth1
  • python312Packages.keystoneauth1.dist
  • python312Packages.openstackdocstheme
  • python312Packages.openstackdocstheme.dist
  • python312Packages.openstacksdk
  • python312Packages.openstacksdk.dist
  • python312Packages.openstacksdk.man
  • python312Packages.os-client-config
  • python312Packages.os-client-config.dist
  • python312Packages.osc-lib
  • python312Packages.osc-lib.dist
  • python312Packages.osc-placement
  • python312Packages.osc-placement.dist
  • python312Packages.oslo-concurrency
  • python312Packages.oslo-concurrency.dist
  • python312Packages.oslo-config
  • python312Packages.oslo-config.dist
  • python312Packages.oslo-context
  • python312Packages.oslo-context.dist
  • python312Packages.oslo-db
  • python312Packages.oslo-db.dist
  • python312Packages.oslo-i18n
  • python312Packages.oslo-i18n.dist
  • python312Packages.oslo-log
  • python312Packages.oslo-log.dist
  • python312Packages.oslo-serialization
  • python312Packages.oslo-serialization.dist
  • python312Packages.oslo-utils
  • python312Packages.oslo-utils.dist
  • python312Packages.osprofiler
  • python312Packages.osprofiler.dist
  • python312Packages.python-aodhclient
  • python312Packages.python-aodhclient.dist
  • python312Packages.python-barbicanclient
  • python312Packages.python-barbicanclient.dist
  • python312Packages.python-designateclient
  • python312Packages.python-designateclient.dist
  • python312Packages.python-glanceclient
  • python312Packages.python-glanceclient.dist
  • python312Packages.python-heatclient
  • python312Packages.python-heatclient.dist
  • python312Packages.python-ironicclient
  • python312Packages.python-ironicclient.dist
  • python312Packages.python-jenkins
  • python312Packages.python-jenkins.dist
  • python312Packages.python-keystoneclient
  • python312Packages.python-keystoneclient.dist
  • python312Packages.python-manilaclient
  • python312Packages.python-manilaclient.dist
  • python312Packages.python-mistralclient
  • python312Packages.python-mistralclient.dist
  • python312Packages.python-novaclient
  • python312Packages.python-novaclient.dist
  • python312Packages.python-swiftclient
  • python312Packages.python-swiftclient.dist
  • python312Packages.python-watcherclient
  • python312Packages.python-watcherclient.dist
  • python312Packages.python-zaqarclient
  • python312Packages.python-zaqarclient.dist
  • python312Packages.python-zunclient
  • python312Packages.python-zunclient.dist
  • python312Packages.stestr
  • python312Packages.stestr.dist
  • python312Packages.tempest
  • python312Packages.tempest.dist
  • reno
  • reno.dist

@bjornfor
Copy link
Contributor Author

bjornfor commented Dec 9, 2024

14 packages failed to build:

No regressions; they fail also on the base branch.

@Bot-wxt1221 Bot-wxt1221 self-requested a review December 9, 2024 13:02
Copy link
Member

@Bot-wxt1221 Bot-wxt1221 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR title doesn't fit CONTRIBUTION.md

@bjornfor
Copy link
Contributor Author

bjornfor commented Dec 9, 2024

PR title doesn't fit CONTRIBUTION.md

Correct. I wasn't sure what to put there, because the individual commits touch various parts of the tree. So whatever pattern I chose for the PR title I felt it was "wrong". But OK, I can update it to match the guidelines.

@bjornfor bjornfor changed the title Fix jenkins-job-builder jenkins-job-builder: fix build Dec 9, 2024
Copy link
Member

@Bot-wxt1221 Bot-wxt1221 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Diff LGTM.

@Bot-wxt1221
Copy link
Member

@ofborg test jenkins

@@ -29,6 +27,7 @@ buildPythonPackage rec {
build-system = [ setuptools ];

dependencies = [
distutils
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is wrong. distutils should go to pbr like I did in #362467 because openstackdocstheme has no direct dependency on it and this likely also fixes other packages which I didn't explicitly tested https://github.com/search?q=repo%3Aopenstack%2Fopenstackdocstheme%20distutils%20&type=code

@@ -14,9 +15,6 @@ buildPythonPackage rec {
version = "3.4.0";
pyproject = true;

# breaks on import due to distutils import through pbr.packaging
disabled = pythonAtLeast "3.12";
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

openstack is very picky about versions and generally there is usually something that breaks in pbr or maybe in other parts up to openstackclient-full and I am pretty confident that 3.13 will most likely break some dependency again.

@@ -39,6 +41,7 @@ buildPythonPackage rec {
'';

dependencies = [
packaging
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@wegank wegank added the 12.approvals: 1 This PR was reviewed and approved by one reputable person label Dec 9, 2024
@ofborg ofborg bot added the 8.has: package (new) This PR adds a new package label Dec 10, 2024
@wegank wegank added the 12.approved-by: package-maintainer This PR was reviewed and approved by a maintainer listed in the package label Dec 10, 2024
@bjornfor bjornfor marked this pull request as draft December 11, 2024 09:03
@bjornfor
Copy link
Contributor Author

Due to the merge of #362467 I reworked this patch set onto staging in these two PRs: #364883 #364884

@bjornfor bjornfor closed this Dec 13, 2024
@bjornfor bjornfor deleted the fix-nixos-jenkins-jobs branch December 13, 2024 12:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
6.topic: nixos Issues or PRs affecting NixOS modules, or package usability issues specific to NixOS 6.topic: python 8.has: package (new) This PR adds a new package 10.rebuild-darwin: 101-500 10.rebuild-linux: 101-500 12.approvals: 1 This PR was reviewed and approved by one reputable person 12.approved-by: package-maintainer This PR was reviewed and approved by a maintainer listed in the package backport release-24.11 Backport PR automatically
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Build failure: python312Packages.jenkins-job-builder
4 participants