Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Specifying a Snakemake scheduler #161

Open
lkhilton opened this issue Jan 16, 2021 · 4 comments
Open

Specifying a Snakemake scheduler #161

lkhilton opened this issue Jan 16, 2021 · 4 comments

Comments

@lkhilton
Copy link
Member

Since adding the ILP scheduler, which is default as of Snakemake 5.26.1, I have a ton of issues with workflows with a large number of checkpoints. There are a number of GitHub issues related to this on the Snakemake GitHub page, but it hasn't been fixed yet. An easy workaround is to specify "--scheduler greedy" whenever launching Snakemake, which reverts to the original scheduling algorithm. It's easy enough to add this to the GAMBL wrappers, but is there a way to add this requirement to the dependency checking section at the top of each Snakefile so that other users don't struggle with this issue?

@rdmorin
Copy link
Collaborator

rdmorin commented Jan 16, 2021

Seems reasonable. Does the setting get stored in the config?

@lkhilton
Copy link
Member Author

Not that I know of, hence I'm not sure how easy it would be to implement.

@rdmorin
Copy link
Collaborator

rdmorin commented Jan 16, 2021

Have we ruled out bundling the wrappers with LCR-modules and adding some more for other schedulers? Are they too tailored to our setup?

@Lakshay-sethi
Copy link
Contributor

Lakshay-sethi commented Apr 27, 2021

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants