Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dataset Submission: HakaiBottleSampleResearch #15

Open
6 of 12 tasks
JessyBarrette opened this issue Feb 4, 2021 · 4 comments
Open
6 of 12 tasks

Dataset Submission: HakaiBottleSampleResearch #15

JessyBarrette opened this issue Feb 4, 2021 · 4 comments
Assignees
@JessyBarrette
Labels
Format Major Revisions An external tool is needed to transform the data in a compatible format. Submission

Comments

@JessyBarrette
Copy link
Contributor

JessyBarrette commented Feb 4, 2021 •
edited
Loading

Hakai Dataset Submission

Below are listed all the different steps related to the initial submission of a dataset.

A more detailed written and visual description of every step is available respectively
here and here.

Submission steps

Initial Submission (Data Administrator)

  • Original Data Submission
  • CIOOS Metadata Form completed

ERDDAP Dataset Creation (Data Integrator)

  • Dataset Transformation (Format label)
    • 🟢 Format Compatible
    • 🟡 Format Minor Revisions
    • 🟠 Format Major Revisions
    • 🔴 Format Incompatible/Missing Information
  • Near Real-time Data Integration
  • QARTOD Integration
  • ERDDAP Integration
  • ERDDAP Dataset Documentation
  • ERDDAP Test Locally
  • Add Dataset to Development Branch

Dataset Review (Data Administrator)

  • Dataset Development Branch Revision (Reviewer Label)
    • 🟢 Reviewer Approved
    • 🟡 Reviewer Minor Revisions
    • 🟠 Reviewer Major Revisions

Dataset Completion (Data Integrator)

  • Merge Development Dataset to Production Branch
  • COMPLETED
@JessyBarrette JessyBarrette self-assigned this Feb 4, 2021
@JessyBarrette JessyBarrette added Reviewer Major Revisions Data Administrator suggests issues with the data itself or with the erddap dataset. Format Major Revisions An external tool is needed to transform the data in a compatible format. and removed Reviewer Major Revisions Data Administrator suggests issues with the data itself or with the erddap dataset. labels Feb 11, 2021
@JessyBarrette
Copy link
Contributor Author

JessyBarrette commented Feb 11, 2021 •
edited
Loading

Only the following hakai sites are available as of now: QU39, KC10, DFO2, QU43

@JessyBarrette
Copy link
Contributor Author

Some changes were requested to the workflow. Few sample types will be taken down for now until we have a better number of Research ready datasets. For now:

  • Only the DNA data will be integrated
  • CTD data will be retrieved from the Hakai Research Dataset

@JessyBarrette JessyBarrette changed the title Dataset Submission: HakaiBottleProvisional Dataset Submission: HakaiBottleSampleResearch Apr 27, 2021
@JessyBarrette
Copy link
Contributor Author

In order to save the original work completed on the bottle dataset two ERDDAP datasets were added on goose:

The Complete Bottle Dataset:
https://goose.hakai.org/erddap/tabledap/HakaiBottleCompleteProvisional.html

And the Reduced Bottle Datasets:
https://goose.hakai.org/erddap/tabledap/HakaiBottleReducedProvisional.html

Both are using the same sources files.

@JessyBarrette
Copy link
Contributor Author

The hakai-bottle-tool package was updated and packaged as a python package.

Joined CTD data to bottle can be generated by using the package itself or the Jupyter Notebook:
https://colab.research.google.com/github/HakaiInstitute/hakai-bottle-tool/blob/master/run_hakai_bottle_tool.ipynb

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@JessyBarrette JessyBarrette

Labels
Format Major Revisions An external tool is needed to transform the data in a compatible format. Submission
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@JessyBarrette