Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fails for local installations of dataverse with local filesystem #2

Open
atanikan opened this issue May 24, 2022 · 2 comments
Open

Comments

@atanikan
Copy link

Hi,

I am using https://github.com/IQSS/dataverse-docker for our team's local installation of dataverse. We are very interested in integrating Globus to use it for upload/download of files instead of the native API.

Can Globus be used for the local setup of dataverse along with a local file system. We don't need an S3 bucket.

If possible please detail the config.json. Appreciate any help. Thank you

@pdurbin
Copy link
Contributor

pdurbin commented Aug 22, 2022

@atanikan hi, please see "Optional Test: Globus POSIX Endpoint" at the Community Dataverse-Globus Setup and Configuration doc at https://docs.google.com/document/d/1mwY3IVv8_wTspQC0d4ddFrD2deqwr-V5iAGHgOy4Ch8/edit?usp=sharing (via https://dataverse-guide--8891.org.readthedocs.build/en/8891/developers/big-data-support.html#globus-file-transfer via IQSS/dataverse#8891 ).

I'm not sure if it's actually supported. @qqmyers might know.

@qqmyers
Copy link
Contributor

qqmyers commented Aug 22, 2022

Not today, but it might not be that hard to do. The Scholars Portal/Borealis team probably knows better but as long as Dataverse and Globus (via this app) can agree on which files they are talking about, it would work. There are some config settings/communications sending the S3 bucket between Dataverse and this app right now which would fail for file stores, but sending equivalent info about the file path between them might be enough. The basic mechanism is that the app transfers the files via Globus and then tells Dataverse where to find them using it's standard store mechanism, so there isn't much there that is S3 specific.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants