Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OD2 set up server for import files #2958

Open
lsat12357 opened this issue Oct 4, 2023 · 1 comment
Open

OD2 set up server for import files #2958

lsat12357 opened this issue Oct 4, 2023 · 1 comment
Assignees

Comments

@lsat12357
Copy link
Contributor

lsat12357 commented Oct 4, 2023

Descriptive summary

Set up designated server space to be used for uploading content files to be imported into OD2.
Somewhat analogous to /data1/batch. In fact could be /data1/batch repurposed.
wickr suggests that files would not need to remain in the directory for longer than 3 months.
It is also possible that the current archives sitting on /data1/batch can be removed? as all of that content should be migrated and now duplicated on /od2_migration.

Expected behavior

Designated curators with admin access? would upload (via scp? kubectl cp?) compressed batches to the server. In order to use browse_everything it looks like the curator would need to follow up with untarring/unzipping the package. For use with the upload zip option, the package can remain zipped prior to start of import.
It is possible that bulkrax can be configured to unzip in this space as well, unclear if this would be desirable. Currently it is using tmp/shared/imports, and side note, it looks like we'll need to figure out if we can clean these up after the import is complete?

Related work

once we have the path, we can fix the browse_everything config:
#2912

Accessibility Concerns

Add any information here to indicate any known or suspected accessibility issues for this ticket

@decimalator
Copy link
Member

/data/tmp/shared/bulk has been created for this purpose

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants