Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Harvester / Simple URL / Removing jena non-compliant attribute during harvesting #8461

Merged
merged 1 commit into from
Nov 25, 2024

Conversation

fxprunayre
Copy link
Member

Harvester config for test:

{"@id":"100","@type":"simpleurl","owner":["1"],"ownerGroup":["2"],"ownerUser":["undefined"],"site":{"name":"dcat","uuid":"38630a58-14fc-4d39-a483-d6ba4562afab","account":{"use":false,"username":[],"password":[]},"url":"https://ontwikkel.dov.vlaanderen.be/geonetwork/srv/api/records/85a4d2f3-fc4c-4798-bf53-1db9e8b81d2c/formatters/xml","icon":"blank.png","loopElement":".","numberOfRecordPath":[],"recordIdPath":".//dcat:record/*/dct:identifier","pageSizeParam":[],"pageFromParam":[],"toISOConversion":[]},"content":{"validate":"NOVALIDATION","importxslt":"none","batchEdits":"[]","translateContent":false,"translateContentLangs":"","translateContentFields":[]},"options":{"every":"0 0 0 ? * *","oneRunOnly":false,"overrideUuid":"SKIP","status":"active"},"privileges":[{"@id":"1","operation":[{"@name":"view"},{"@name":"dynamic"},{"@name":"download"}]}],"ifRecordExistAppendPrivileges":false,"info":{"lastRun":"2024-10-23T13:55:04.347024528Z","running":true,"result":{"added":"0","atomicDatasetRecords":"0","badFormat":"0","collectionDatasetRecords":"0","datasetUuidExist":"0","privilegesAppendedOnExistingRecord":"0","doesNotValidate":"0","xpathFilterExcluded":"0","duplicatedResource":"0","fragmentsMatched":"0","fragmentsReturned":"0","fragmentsUnknownSchema":"0","incompatible":"0","recordsBuilt":"0","recordsUpdated":"0","removed":"0","serviceRecords":"0","subtemplatesAdded":"0","subtemplatesRemoved":"0","subtemplatesUpdated":"0","total":"0","unchanged":"0","unknownSchema":"0","unretrievable":"0","updated":"0","thumbnails":"0","thumbnailsFailed":"0"}}}

Error is

org.apache.jena.riot.RiotException: [line: 1, col: 744] {E201} Illegal attributes on rdf:RDF

Because of xsi:schemaLocation

<rdf:RDF ... xsi:schemaLocation="http://www.w3.org/1999/02/22-rdf-syntax-ns# http://www.openarchives.org/OAI/2.0/rdf.xsd">

Checklist

  • I have read the contribution guidelines
  • Pull request provided for main branch, backports managed with label
  • Good housekeeping of code, cleaning up comments, tests, and documentation
  • Clean commit history broken into understandable chucks, avoiding big commits with hundreds of files, cautious of reformatting and whitespace changes
  • Clean commit messages, longer verbose messages are encouraged
  • API Changes are identified in commit messages
  • Testing provided for features or enhancements using automatic tests
  • User documentation provided for new features or enhancements in manual
  • Build documentation provided for development instructions in README.md files
  • Library management using pom.xml dependency management. Update build documentation with intended library use and library tutorials or documentation

Funded by https://metadata.vlaanderen.be/

@fxprunayre fxprunayre added this to the 4.4.7 milestone Oct 23, 2024
Copy link

sonarcloud bot commented Oct 23, 2024

Copy link
Collaborator

@joachimnielandt joachimnielandt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Using this in VL.

@fxprunayre fxprunayre merged commit 7ba4d47 into main Nov 25, 2024
9 checks passed
@fxprunayre fxprunayre deleted the feature/harvester-simpleurl-rdf-xsischemalocation branch November 25, 2024 08:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants