Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update/align with paper #11

Open
wants to merge 124 commits into
base: main
Choose a base branch
from
Open

Update/align with paper #11

wants to merge 124 commits into from

Conversation

nick-j-roberts
Copy link
Member

Major refactor, revises workflow
Old workflow:

  • Upload resource to s3, packaging in metadata to use when creating RDF
  • Read resource from s3, parse metadata and put TTL file somewhere to register it as a dataset

New workflow:

  • Utilize custom extension for CKAN to handle AORC datasets
  • Collect metadata during the data processing phase, package this into a JSON object
  • Send POST request to CKAN instance with extensions enabled
  • Allow CKAN to handle the dataset URI creation and cataloguing

@nick-j-roberts nick-j-roberts requested a review from slawler July 7, 2023 19:44
@nick-j-roberts
Copy link
Member Author

For now, the CKAN extensions utilized live here. Plan to move them and test integration with existing Dewberry CKAN instance

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant