Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

articles in Error state #290

Open
4 tasks done
ErnestaP opened this issue Jan 29, 2024 · 2 comments
Open
4 tasks done

articles in Error state #290

ErnestaP opened this issue Jan 29, 2024 · 2 comments

Comments

@ErnestaP
Copy link

ErnestaP commented Jan 29, 2024

More than 62 articles are in error state with an error message:
IOError: [Errno 2] No such file or directory: u'/data/files/93/04/d395-85d9-498b-9dbc-86d3b77e5f72/data'
I checked a few articles, and it seems that they were harvested around 2021-06, and we are receiving updates from time to ti time.
Update with PDFA files we received in 2021-07-23 (vtex00490082_a-2b). After that, we did not receive these articles' updates until now.

2024-01-26 we received the updates, however without PDFAs.

  • Clean workflows: Restart these workflows in ERROR state
  • Check do we have the data in EOS,
  • I̶F̶ ̶Y̶E̶S̶,̶ ̶c̶o̶p̶y̶ ̶t̶h̶e̶ ̶m̶i̶s̶s̶i̶n̶g̶ ̶f̶i̶l̶e̶s̶ ̶t̶o̶ ̶t̶h̶e̶ ̶c̶u̶r̶r̶e̶n̶t̶ ̶f̶i̶l̶e̶s̶ ̶s̶y̶s̶t̶e̶m̶
  • IF NO, locally reharvest zip folder which has pdfas ((vtex00490082_a-2b), verify do the files are in the location. After, locally re-harvest the update (CERNJ000000009969)
    for the records, the path after update, changes. For examples:
    ERROR: https://repo.scoap3.org/admin/workflow/details/?url=%2Fadmin%2Fworkflow%2F%3Fflt0_21%3D3&id=8aeea74c-bc4f-11ee-a328-42eccb3f995a
    path: /data/files/6c/42/35ad-4f39-48b1-8f7e-63aa95f5ce95/data

UPDATED JUST WITH PDFAs from ZIP: https://repo.scoap3.org/admin/workflow/details/?url=%2Fadmin%2Fworkflow%2F&id=aa449c30-beb3-11ee-ac69-4ee990e29a75
path: /data/files/2f/83/3b11-db6d-49a1-a0b1-571460014e34/data

full list of missing pdfa's (the ones that we know from ERROR messages)

{u'/data/files/03/0f/c88a-74b1-467f-b299-d05a52239b39/data',
 u'/data/files/04/a1/c361-f347-498e-906f-ed54f465e269/data',
 u'/data/files/06/c9/68d0-b37c-4835-b044-ab5ea5d36a3e/data',
 u'/data/files/0e/d6/b28b-f8e1-47a1-93a3-e8af43d322e9/data',
 u'/data/files/0f/09/32a4-ca6a-4f2b-ad5a-d52be5c85b84/data',
 u'/data/files/0f/0c/3cbd-cacd-46dc-b20a-2b20808805c3/data',
 u'/data/files/17/8f/9d81-89d4-438c-942c-a17ef2610051/data',
 u'/data/files/18/61/041f-1e96-4125-8f22-b726e60a19c7/data',
 u'/data/files/1a/90/dcc0-577a-41fc-86c6-4ad2349d18bb/data',
 u'/data/files/22/17/a33c-b1d5-471b-a524-26462b569d5b/data',
 u'/data/files/2d/09/4348-ee68-4cd3-9c02-0187a86d1138/data',
 u'/data/files/2e/83/e827-18d4-49f6-a947-9c80a5b79739/data',
 u'/data/files/2e/cf/0974-6e6c-415a-abf9-178ef0484b68/data',
 u'/data/files/31/84/e835-5f33-4673-965d-97dfdabe3203/data',
 u'/data/files/31/fe/cf66-3378-475e-9714-795f364c1ea0/data',
 u'/data/files/33/1f/a1ee-6bc1-45be-823f-17f1de16e7ad/data',
 u'/data/files/39/28/38ee-3c0e-47a4-bdf9-fae545bb9832/data',
 u'/data/files/3c/8d/2d41-c52e-4865-9a67-82d2a04b7072/data',
 u'/data/files/54/8a/4d76-3548-4ae2-947c-a026b9a2b631/data',
 u'/data/files/55/70/56ec-fe22-4bc2-9183-c739f5519bbf/data',
 u'/data/files/59/dd/1642-6a7f-4933-af27-b22343c563a5/data',
 u'/data/files/5d/73/87c5-79ef-484c-aed7-66cc4fd6a750/data',
 u'/data/files/68/03/a823-bcd0-45ee-a11f-5a04299638ef/data',
 u'/data/files/69/8d/7c9e-4636-4ecb-895d-21acbabfca61/data',
 u'/data/files/6b/cf/9612-c0d6-4833-832d-6b6aa745f0bf/data',
 u'/data/files/6c/42/35ad-4f39-48b1-8f7e-63aa95f5ce95/data',
 u'/data/files/6f/d4/5122-1587-4e07-8cd2-3b589dcbebc7/data',
 u'/data/files/71/7f/d0a7-9d7e-463f-9379-4f8e487c8a01/data',
 u'/data/files/74/a6/1e3a-9a8b-4ec2-8ca5-516913df81ae/data',
 u'/data/files/76/81/d36d-ecbb-476b-9033-2d70ae170c19/data',
 u'/data/files/77/2d/03b8-09c3-4c02-bb8d-d81d51099a69/data',
 u'/data/files/7a/d8/8c86-aafc-4b66-a092-ea8157a43b48/data',
 u'/data/files/80/20/7640-b46e-4f4c-8cb4-1b3d1513ffdf/data',
 u'/data/files/86/8b/2c60-9f68-48dd-aec0-c311eeb44722/data',
 u'/data/files/86/f7/d29c-26d8-4581-916e-c7587b737a29/data',
 u'/data/files/89/a5/1342-e3f7-4679-bf7d-4d6b1e1ce455/data',
 u'/data/files/8a/4f/76e9-e1ce-4e29-b9b1-c7678cec1da8/data',
 u'/data/files/90/e8/df2e-7c6c-45d9-a157-a647d67a3e09/data',
 u'/data/files/93/04/d395-85d9-498b-9dbc-86d3b77e5f72/data',
 u'/data/files/94/ab/0fea-12cf-4a6c-a0a5-64064d356858/data',
 u'/data/files/98/fb/466d-e07e-484b-86da-39ba53dc6b59/data',
 u'/data/files/b5/9a/1c4d-6674-4bd7-b417-9d0d43ae0d53/data',
 u'/data/files/b8/02/819d-cea2-4ba1-8599-7096045419b6/data',
 u'/data/files/b9/8e/ed09-76f4-48ab-8596-8adae5fa59d2/data',
 u'/data/files/be/ef/a442-23b6-46b6-a8ed-5615f85847b5/data',
 u'/data/files/c9/e0/7334-9dff-44be-ba34-f2c584c33094/data',
 u'/data/files/cc/99/a898-f56c-484a-9169-5532392699db/data',
 u'/data/files/cf/13/2f81-671f-4e84-bb88-9339563cf80b/data',
 u'/data/files/d4/40/65a0-7cfd-4e14-896b-8f0473ac4ed2/data',
 u'/data/files/d4/d2/eceb-298b-407b-8f04-78bcca0dcb31/data',
 u'/data/files/d6/5b/543f-f330-4350-b8bd-af7b5defecd2/data',
 u'/data/files/d9/e0/e241-ae8b-4d84-9a99-271f32c4c64e/data',
 u'/data/files/dd/05/7b65-3f83-4577-9240-9c29459741e7/data',
 u'/data/files/dd/26/3ebc-19a0-44e4-841c-a6e25af241eb/data',
 u'/data/files/de/2f/53bf-dbde-4479-b7f1-0e68b5edcab6/data',
 u'/data/files/df/b9/1ea3-6f57-4ce1-bb23-b80c04dbc063/data',
 u'/data/files/e0/ce/6a75-6ef4-4c00-94ed-00e2ab0b8ab4/data',
 u'/data/files/e1/c4/2fb6-9cd1-4fcf-aa35-548a7185edfd/data',
 u'/data/files/e4/af/8195-a1d0-4bb3-9f49-3c25ff9ae781/data',
 u'/data/files/e9/66/ddc7-de17-4b6e-a579-7311ba5cd53b/data',
 u'/data/files/f1/dd/172e-86d1-4c90-8b43-c4fc95816f06/data',
 u'/data/files/fc/c4/580b-a32f-4c3f-b5ed-76bf5ff24903/data'}
@ErnestaP
Copy link
Author

ErnestaP commented Jan 29, 2024

Ben confirmed that none of them are in EOS

@ErnestaP
Copy link
Author

the location of files changed, but the update worked

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant