Change base OS image to Ubuntu-24.04 in CI testing

[Damien-Chen]

In current ci.yml, base OS image is ubuntu-22.04, should we move to the latest LTS verion: ubuntu-24.04 ?

pool:
vmImage: ubuntu-22.04

To go further, if we should replace all current CI testing which run on ubuntu-22.04 to ubuntu-24.04 ?

Linked PRs

• gh-122544: Change OS image in GitHub Actions to ubuntu-24.04 #122566
• gh-122544: Change OS image in readthedocs.yml to ubuntu-24.04 #122568
• gh-122544: Change OS image in Azure Pipelines to ubuntu-24.04 #122570
• [3.13] gh-122544: Change OS image in readthedocs.yml to ubuntu-24.04 (GH-122568) #122593
• [3.12] gh-122544: Change OS image in readthedocs.yml to ubuntu-24.04 (GH-122568) #122594
• gh-122544: Change base OS image in Azure pipeline to ubuntu-24.04. #125344
• [3.13] gh-122544: Change OS image in Azure pipeline to Ubuntu 24.04 (GH-125344) #126479
• [3.12] gh-122544: Change OS image in Azure pipeline to Ubuntu 24.04 (GH-125344) #126480
• [3.13] gh-122544: Change OS image in GitHub Actions to Ubuntu 24.04 (#122566) #126619
• [3.12] gh-122544: Change OS image in GitHub Actions to Ubuntu 24.04 (#122566) #126621

[Eclips4]

cc @hugovk @ezio-melotti

[hugovk]

Thanks for the report, we're using ubuntu-22.04 in Read the Docs, Azure Pipelines and GitHub Actions:

❯ rg ubuntu-22.04
.readthedocs.yml
11:  os: ubuntu-22.04

.azure-pipelines/ci.yml
8:    vmImage: ubuntu-22.04

.azure-pipelines/pr.yml
8:    vmImage: ubuntu-22.04
20:    vmImage: ubuntu-22.04

.github/workflows/build.yml
47:    runs-on: ubuntu-22.04
198:    runs-on: ubuntu-22.04
264:    runs-on: ubuntu-22.04
378:    runs-on: ubuntu-22.04

.github/workflows/reusable-wasi.yml
12:    runs-on: ubuntu-22.04

.github/workflows/reusable-tsan.yml
22:    runs-on: ubuntu-22.04

.github/workflows/reusable-ubuntu.yml
17:    runs-on: ubuntu-22.04

Yes, let's upgrade, assuming all the dependencies and everything installs fine.

Would you like to open some PRs? I suggest a separate PR for each of Read the Docs, Azure Pipelines and GitHub Actions.

[Damien-Chen]

Sure!, Of course, I'd love to contribute to this, let me first investigate if it would affect the result of CI testing if just simply change ubuntu-22.04 to ubuntu-24.04.

[picnixz]

We are also using Ubuntu 22.04 for generating the configure script in the Docker image but I don't think we should change this one. This is in Tools/build/regen-configure.sh (I don't know whether the CI/CD is using its own packages or whether is using the docker script to check the configuration scripts)

[hugovk]

The comment at the top says they should match:

cpython/Tools/build/regen-configure.sh

Lines 5 to 8 in fda6bd8

	# The check_generated_files job of .github/workflows/build.yml must kept in
	# sync with this script. Use the same container image than the job so the job
	# doesn't need to run autoreconf in a container.
	IMAGE="ubuntu:22.04"

Which should be the same as this one:

cpython/.github/workflows/build.yml

Lines 43 to 47 in fda6bd8

	check_generated_files:
	name: 'Check if generated files are up to date'
	# Don't use ubuntu-latest but a specific version to make the job
	# reproducible: to get the same tools versions (autoconf, aclocal, ...)
	runs-on: ubuntu-22.04

[picnixz]

The comment at the top says they should match:

Oh then we should update both of them then! (and I'll need to update my PR in the devguide as well)

[Damien-Chen]

Some other yml file based on ubunut-latest, for exmaple: in jit.yml. based on
https://github.com/actions/runner-images description, ubuntu-latest is actually ubuntu-22.04, should those file mentioned ubuntu-latest need to upgrade ubuntu version ?

     architecture: x86_64

        runner: ubuntu-latest
        compiler: gcc
      - target: x86_64-unknown-linux-gnu/clang
        architecture: x86_64
        runner: ubuntu-latest
        compiler: clang
      - target: aarch64-unknown-linux-gnu/gcc
        architecture: aarch64
        runner: ubuntu-latest
        compiler: gcc
      - target: aarch64-unknown-linux-gnu/clang
        architecture: aarch64
        runner: ubuntu-latest
        compiler: clang

[hugovk]

No, let's not change any ubuntu-latest.

In fact, https://github.com/actions/runner-images?tab=readme-ov-file#available-images says ubuntu-24.04 is still beta, maybe we should wait until it is in GA (General Availability)?

Do you know when GA is planned?

[Damien-Chen]

According to there discussion in
actions/runner-images#9691
The GA will be somewhere in August-2024, I think it should be soon.

I think we can move all CI-testing step-by-step.
First change trivial CI testiing(like readthedocs) to ubuntu-24.04 to make sure everything works correctly.
If everthing goes well, then we can wait its GA and move core part(like checking JIT) to ubuntu-24.04 gradually

[Damien-Chen]

Close PR for Azure Pipeline as it currently not supports ubuntu-24.04

[Damien-Chen]

According to latest update in Github Action, ubuntu-24.04 is release as GA now, let`s continue to work it.

[hugovk]

Note: we pinned ubuntu-latest to ubuntu-22.04 in .github/workflows/jit.yml because of some oddness with ubuntu-24.04. We'll upgrade it at some later date.

See #125564 / #125560.