Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Systems: SGCI Resource Specification - Support API in Tapis V3 #3

Open
1 task
scblack321 opened this issue Aug 2, 2021 · 2 comments
Open
1 task
Assignees

Comments

@scblack321
Copy link
Collaborator

  • Design endpoint to import from SGCI catalog
@scblack321 scblack321 self-assigned this Aug 2, 2021
@scblack321
Copy link
Collaborator Author

The SGCI Resource Specification effort (aka Tech Summit) is creating a reference database (via github) and reference API implementation to be used for sharing HPC and Cloud resources. The goal is for Tapis V3 to support the reference API allowing for a Tapis site to pull in resource definitions, store them locally and make them available to site users. Except from 4/24/20 e-mail written by Joe S:

Gateways and frameworks can and should utilize a local, database-backed catalog of the resources that provides an API for searching for and reading the descriptions. That system should periodically sync/receive updates from github for changes. We will provide a reference implementation of this API system, and the major frameworks (Airavata, HubZero and Tapis) will commit to hosting said API system and incorporating it into their services.

Suresh and Dimuthu made some serious progress on the github catalog and reference implementation of the API, and they gave a walkthrough and demo of initial versions of each:
[1] https://github.com/SGCI/computational-resource-catalog
[2] https://github.com/SGCI/computational-resource-reference-implimentation

An instance of the reference API is deployed here, ready to be tried out:
https://resources.sgci.scigap.org

and there is some very nice documentation, including an overall workflow diagram here:
https://docs.google.com/document/d/1gr5dl-5qqlsajKYeUupc5seeDWAE2BaRGMmaJoKUaPY/edit

Big thanks to Suresh and Dimuthu for all of the above!

Our discussion also included the following points and action items:

1. The group thought it would be best to prioritize creating designs for how the resource API would be incorporated into the existing frameworks: Airavata, HubZero and Tapis. We expect the exercise of working out the designs to help improve and finalize the resource spec itself. Steve and Joe will work on Tapis and think about HPC resources, Suresh and Dimuthu will work on Airavata and think about HPC and cloud resource, Daniel will work on HubZero.

@scblack321
Copy link
Collaborator Author

Add Tapis v3 Systems endpoints to create and update system definitions based on an SGCI Resource with the latest information from the SGCI Resource catalog.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants