New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Harvesting fixes #633

Open

1 task

drjova opened this issue Dec 12, 2024 · 1 comment

Labels

project: backoffice type: bug

Milestone

Contributor

drjova commented Dec 12, 2024

There are some issues with the metadata from the harvesting

observables keywords are messed up, they should be split in multiple keywords, one per element

drjova added project: backoffice type: bug labels

drjova added this to the data MVP milestone

Collaborator

DonHaul commented Dec 12, 2024

Additional things to check:

add parameter for setting since when we want to harvest.
make sure that collected_ids always fetches the data of the day before the first execution. i.e. if it was first run on 14/12 but it failed, if its rerun on 17/12 is should still fetch the records of 13/12 not of 16/12

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment