Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automate new builds/releases after Augur, Auspice, etc. releases #2

Open
tsibley opened this issue Oct 25, 2022 · 4 comments
Open

Automate new builds/releases after Augur, Auspice, etc. releases #2

tsibley opened this issue Oct 25, 2022 · 4 comments
Labels
bug Something isn't working

Comments

@tsibley
Copy link
Member

tsibley commented Oct 25, 2022

Releases of Augur and Auspice (and maybe one or two other?) trigger new builds/releases of our Docker runtime image by triggering the CI of nextstrain/docker-base. This repo's CI should also be triggered by new Augur and Auspice (and maybe other) internal upstream releases, with the caveat that they should wait until after the Conda packages for those projects are also released (since that's what consumed here). Since those are Bioconda recipes, it might be more hard to trigger directly. Instead we might:

  • Poll the Anaconda API for new versions in the Bioconda channel using a scheduled action in this repo.
  • Register webhooks for Bioconda repo events and trigger upon receiving them.
  • Moving Conda packaging for Augur and Auspice into their respective repos and publishing on our own channel instead.
@tsibley tsibley added the bug Something isn't working label Oct 25, 2022
@jameshadfield
Copy link
Member

While we're thinking about this, it would be good to automate the bioconda PRs for auspice. Currently one has to wait ~15min for the npm release to be registered before making a manual PR to bioconda. I don't know how augur works here.

@tsibley
Copy link
Member Author

tsibley commented Oct 25, 2022

Bioconda has an regular updater process that notices new PyPI releases.

We have an open issue for automating Bioconda updates for Auspice, with suggested solutions.

@victorlin
Copy link
Member

publishing on our own channel instead

I was just thinking about this today. I vote for this, since it allows us to skip the manual approval process required to make our packages available on Bioconda, which is dependent on external availability and can take several hours.

Bioconda is likely to remain the popular choice for ambient runtimes, so maybe this should be done in addition to, rather than replacing, the Bioconda package.

@victorlin
Copy link
Member

This was discussed during today's dev chat.

  • For publishing on our own channel, we would have to consider how to handle build dependencies under the hood, which is something the Bioconda/conda-forge have already set up.
  • Another solution is to make conda-base work with unmerged Bioconda PRs for Augur/Auspice/etc.

Thinking through all the options again, I'm +1 for the approach of "Poll the Anaconda API for new versions in the Bioconda channel using a scheduled action in this repo."

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
No open projects
Status: Backlog
Development

No branches or pull requests

3 participants