Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update resourcesdir todi.py #244

Open
wants to merge 1 commit into
base: alps
Choose a base branch
from
Open

Update resourcesdir todi.py #244

wants to merge 1 commit into from

Conversation

lucamar
Copy link
Collaborator

@lucamar lucamar commented Nov 19, 2024

Provide folder with resources on Todi, that would be required for some applications (e.g. NAMD)

Provide folder with resources on Todi
@lucamar lucamar added the enhancement New feature or request label Nov 19, 2024
@lucamar lucamar self-assigned this Nov 19, 2024
@RMeli
Copy link
Member

RMeli commented Nov 19, 2024

Thanks @lucamar!

@ekouts
Copy link
Collaborator

ekouts commented Nov 21, 2024

Hi @lucamar and @RMeli . After discussing it in vcue, we decided to not use the resourcesdir anymore in the new systems, unless really necessary. (We have a note in the bottom of this confluence page, in section "Adding larger resources to the tests"). The idea is to make it more portable by moving resources to jfrog, whenever possible.

For this reason we created this directory in jfrog that is open and you get simply wget <jfrog_url>. From what I could find, we only need a few MB of data for production tests (including NAMD) so the pulling should be very quick.

I believe cscs staff can push to the directory (with credentials), but then pull without. Please have a look and let us know if you still think that we need the resourcesdir.

@RMeli
Copy link
Member

RMeli commented Nov 21, 2024

Thanks @ekouts, I'll add the necessary machinery in #245 to download the resources from JFrog.

I believe cscs staff can push to the directory (with credentials), but then pull without.

Yes, I think this is indeed the case. The NAMD test already needs to accesses JFrog to download the source code (because of licensing), so the credentials need to be set in CI anyways (see #245).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants