Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added some of the assumptions/goals to the intro #44

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

hategan
Copy link
Collaborator

@hategan hategan commented Nov 17, 2020

Let's use this PR to discuss the assumptions, motivations, and goals for the API and edit the relevant section appropriately.

One of the topics that came up was that we need to articulate why we are designing a new API rather than using, e.g., SAGA or DRMAA, Flux, or even standard qsub. @andre-merzky is working on this.

Copy link
Collaborator

@andre-merzky andre-merzky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left two comments which I think should be addressed. Thanks!

in an abstract way; that is, it must use a job management API. The only stable
job management API currently available is
[SAGA](http://radical-cybertools.github.io/) [so, wait a minute, how do we
justify not pushing SAGA forward?].
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I will need to leave others to clarify this. One argument I heard on the call (but not one I would make, just repeating) is that SAGA, or at least the name, comes with a certain pre-notation / ballast, and that would at least partially justify to distinguish an Exaworks job API from it.

BTW: DRMAA also is an existing, stable API -- just not a widely implemented one (anymore). As such, we should also motivate why we do not implement DRMAA instead of inventing our own API.

scope, such as [Globus
GRAM](https://en.wikipedia.org/wiki/Grid_resource_allocation_manager),
[SAGA](http://radical-cybertools.github.io/), and
[DRMAA](http://www.drmaa.org/).
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would suggest to add DRMAA, but also Flux here. We could also add POSIX FWIW (qsub etc): even though POSIX does not define an LRM API, it does define those command line tools which are widely considered the standard interface in many LRM implementations.

hategan added a commit that referenced this pull request Mar 21, 2023
It supersedes #44 and fixes #22.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants