Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a shared local instance of the pipeline at NYU #6

Open
shihabdider opened this issue Jan 27, 2025 · 0 comments
Open

Create a shared local instance of the pipeline at NYU #6

shihabdider opened this issue Jan 27, 2025 · 0 comments
Assignees

Comments

@shihabdider
Copy link
Contributor

Description of feature

Numerous network and remote repository issues can be avoided by simply having a local instance of all required files for the pipeline in the NYU cluster. This includes a shared directory for the docker/singularity containers. This should also facilitate a significant speed up on runtime since some of the large files (e.g the PON) no longer needs to be downloaded.

Will need to set up the configuration to check for these files in this shared directory before attempting to download them from remote.

@shihabdider shihabdider added the enhancement New feature or request label Jan 27, 2025
@shihabdider shihabdider self-assigned this Jan 27, 2025
@shihabdider shihabdider removed the enhancement New feature or request label Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant