Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pipeline defined only by name may put burden on pipeline owner #21

Open
nerdstrike opened this issue Feb 15, 2022 · 0 comments
Open

Pipeline defined only by name may put burden on pipeline owner #21

nerdstrike opened this issue Feb 15, 2022 · 0 comments
Labels
musings A concept or tech choice may need improvement

Comments

@nerdstrike
Copy link
Contributor

Our definition for "Pipeline" is name, uri and version, but only the name is constrained as unique - this way the same code can be used for different purposes and parameterisations. There are some possible consequences:

Scenario: A minor change in a given pipeline results in a change in the version.
Assumption: We should not mix/modify existing pipelines for task-provenance reasons
Result: The pipeline owner must register the same pipeline again with the new version and a new name. This forces the pipeline owner to do ad-hoc versioning via naming, and do so wisely.
Example: name="spaceranger", name="spaceranger+fix", name="spaceranger v2" and so on

It is expected on a per-pipeline-execution basis that the outputs will include sufficient provenance on what was run. However, for the purposes of reanalysing prior runs (as in the case of essential pipeline/protocol fixes), do we need to distinguish between versioned executions?

@nerdstrike nerdstrike added the musings A concept or tech choice may need improvement label Feb 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
musings A concept or tech choice may need improvement
Projects
None yet
Development

No branches or pull requests

1 participant