Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run Load Checksums Rake Task in January #2973

Closed
1 task
K8Sewell opened this issue Nov 22, 2024 · 4 comments
Closed
1 task

Run Load Checksums Rake Task in January #2973

K8Sewell opened this issue Nov 22, 2024 · 4 comments

Comments

@K8Sewell
Copy link

K8Sewell commented Nov 22, 2024

Summary

The load ladybird checksums rake task takes significant (12+ hours on Test env.) time to process. The running of the rake task on Production is tentatively planned for January 2025.

Acceptance Criteria

  • rake task run on prod successfully

Engineering Notes

.tsv files have already been generated and they live on the yale data shares

To run task:

nohup rake child_objects:load_ladybird_checksums['/data/10/collection*tsv'] > /data/10/ladybird_checksum_ingest_prd_2025-01.log &

Related Ticket

#2963

@K8Sewell K8Sewell changed the title Run Load Checksums Rake Task Run Load Checksums Rake Task in January Nov 22, 2024
@martinlovell
Copy link
Collaborator

This finished running over the weekend.

There's a big log file that can be accessed via a UAT ec2 instance:
-rw-r--r-- 1 root root 402M Feb 2 00:26 /data/10/ladybird_checksum_ingest_prd_2025-01.log

@K8Sewell
Copy link
Author

K8Sewell commented Feb 3, 2025

Hey @martinlovell would it be possible to throw that log into a place that Lauren and Summer can access a little easier? Please disregard. Grabbing and tossing into shared drive.

@K8Sewell
Copy link
Author

K8Sewell commented Feb 3, 2025

Log available in shared drive.

@sshetenhelm
Copy link

The sample of OIDs I looked out in the "child objects not found" were for objects that either (a) weren't chosen to be migrated or (b) were ingested as new instead of directly migrated (ex. Papyri).

@jillpe jillpe closed this as completed Feb 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants