Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conda environment reproducibility #329

Open
lkhilton opened this issue Sep 11, 2024 · 2 comments
Open

Conda environment reproducibility #329

lkhilton opened this issue Sep 11, 2024 · 2 comments

Comments

@lkhilton
Copy link
Member

I've had a lot of trouble installing conda environments from LCR-modules recently. Many of the environment yaml files seem to contain packages that are no longer available or now conflict with other specified packages. I'm not sure exactly how this happens, but there are a couple of things that we could to try to implement:

  1. We need to stop using the Anaconda defaults channel. I just learned that it is not compatible with conda-forge. In addition, Anaconda has started demanding payment from non-profit organizations who are perceived to be using their code. If we stick to conda-forge and bioconda, and even specify nodefaults in the channels, we can hopefully continue to avoid them.
  2. We probably need to investigate using flags like --from-history when exporting conda environments. This will export only the packages and versions that are specifically requested on installation. All dependencies will be installed based on the requirements of the specified packages at the time of installation. This probably also gives more flexibility for different operating systems.
@Kdreval
Copy link
Collaborator

Kdreval commented Sep 20, 2024

I am working on this and so far tackled all envs from the reference files except 3: bedtools, bcftools and gsutil. Exploring the from history flag for those 🤞 The reference files envs should be addressed 🔜

@Kdreval
Copy link
Collaborator

Kdreval commented Oct 2, 2024

can confirm that from history flag works to re-create min envs ✅ I have regenerated all envs in the reference files workflow and re-built the ones that were failing!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants