Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add templates for publishing non synop/temp data #624

Closed
maaikelimper opened this issue Feb 2, 2024 · 8 comments
Closed

add templates for publishing non synop/temp data #624

maaikelimper opened this issue Feb 2, 2024 · 8 comments
Assignees
Labels
discovery metadata Discovery metadata documentation Improvements or additions to documentation
Milestone

Comments

@maaikelimper
Copy link
Collaborator

maaikelimper commented Feb 2, 2024

I have received multiple requests regardging publishing non synop/temp data :

we could address some of these issues by:

  • adding additional metadata-templates
  • update documentation referring the wis2-topic-hierarchy and wcmp2 repositories
  • update documentation with more examples for data-types other than synop/temp (using universal pipeline)

We could also add more templates like currently we have:

{
    "title": "Hourly synoptic observations from fixed-land stations (SYNOP) ($CENTRE_ID)",
    "identifier": "urn:x-wmo:md:$CENTRE_ID:surface-based-observations.synop",
    "topicHierarchy": "$CENTRE_ID.data.$DATA_POLICY.weather.surface-based-observations.synop",
    "language": "en",
    "retention": "P30D",
    "resolution": "P1H",
    "keywords": ["surface", "land", "observations"],
    "duplicateFromContact": true
}

and

{
    "title": "Upper-level temperature/humidity/wind reports from fixed-land stations (TEMP) ($CENTRE_ID)",
    "identifier": "urn:x-wmo:md:$CENTRE_ID:surface-based-observations.temp",
    "topicHierarchy": "$CENTRE_ID.data.$DATA_POLICY.weather.surface-based-observations.temp",
    "language": "en",
    "retention": "P30D",
    "resolution": "P12H",
    "keywords": ["upper air", "humidity", "wind", "observations"],
    "duplicateFromContact": true
}
@maaikelimper maaikelimper added documentation Improvements or additions to documentation discovery metadata Discovery metadata labels Feb 2, 2024
@maaikelimper maaikelimper added this to the sprint-014 milestone Feb 2, 2024
@maaikelimper maaikelimper self-assigned this Feb 2, 2024
@tomkralidis
Copy link
Collaborator

2024-02-06:

  • we need to consider support data types on a case-by-case basis to ensure alignment in WIS2 proper
  • core data has a defined set per the Unified Data Policy/core catalogue appendix
  • as WTH evolves, we can turn back on topic validation via pywis-topics
  • see 'Variety of data pipelines' in https://github.com/wmo-im/wis2box/wiki/ProjectRoadmap-1.0

@tomkralidis tomkralidis removed this from the sprint-014 milestone Feb 6, 2024
@david-i-berry
Copy link
Member

Something like this for drifters (using the MCF format);

mcf:
    version: 1.0

metadata:
    identifier: urn:wmo:md:${WIS2CENTRE}:surface-observations:drifting-buoy
    hierarchylevel: dataset

identification:
    title: Surface observations from the ${COUNTRY} drifting buoy program
    abstract:
        Surface observations (sea surface temperature, sea level pressure, waves, current) from the \
        ${COUNTRY} drifting buoy program.
    dates:
        creation: null
    keywords:
        default:
            keywords:
                - observations
                - drifting buoy
                - ocean
                - marine
                - waves
                - sea surface temperature
                - sea level pressure
                - ocean currents
        wmo:
            keywords:
                - weather
                - ocean
                - climate
            keywords_type: theme
            vocabulary:
                name: Earth system disciplines as defined by the WMO Unified Data Policy, Resolution 1 (Cg-Ext(2021), Annex 1.
                url: https://github.com/wmo-im/wis2-topic-hierarchy/blob/main/topic-hierarchy/earth-system-discipline/index.csv
    extents:
        spatial:
            - bbox: [-180.0, -90.0, 180.0, 90.0]
              crs: 4326
        temporal:
            - begin: null
              end: null
              resolution: P1H
    rights: WMO Unified Policy for the International Exchange of Earth System Data
    url: https://example.org/fixme

contact:
    pointOfContact: &contact_poc
        organization: ${ORGANISATION}
        url: ${ORGANISATION_HOMEPAGE}
        individualname: ${METADATA_CONTACT_INDIVIDUAL_NAME}
        positionname: ${METADATA_CONTACT_POSITION_NAME}
        phone: ${METADATA_CONTACT_PHONE}
        fax: ${METADATA_CONTACT_FAX}
        address: ${METADATA_CONTACT_ADDRESS}
        city: ${METADATA_CONTACT_CITY}
        administrativearea: ${METADATA_CONTACT_ADMINISTRATIVE_AREA}
        postalcode: ${METADATA_CONTACT_POSTAL_CODE}
        country: ${METADATA_CONTACT_COUNTRY}
        email: ${METADATA_CONTACT_POSITION_EMAIL}
        hoursofservice: ${HOURS_OF_SERVICE}
        contactinstructions: ${METADATA_CONTACT_INSTRUCTION}

    distributor: *contact_poc

Where do we want to collect the templates?

@maaikelimper
Copy link
Collaborator Author

maaikelimper commented Jun 12, 2024

We have defined a location for the templates in wis2box-webapp, but we still only have synop/temp:
https://github.com/wmo-im/wis2box-webapp/tree/main/src/templates

I noted there is a WIP wis2-topic-hierachy to map GTS to WIS2 topics:
wmo-im/wis2-topic-hierarchy#147

Once this issue is resolved we can proceed adding templates for all these topics

@maaikelimper maaikelimper added this to the sprint-015 milestone Jun 12, 2024
@maaikelimper maaikelimper changed the title add templates/examples/guidelines for publishing non synop/temp data add templates for publishing non synop/temp data Jun 12, 2024
@maaikelimper
Copy link
Collaborator Author

@efucile to provide a subset of "stable" topics from those listed in:
wmo-im/wis2-topic-hierarchy#147
for which templates can be developed in anticipation of the fast-track approval

@maaikelimper maaikelimper modified the milestones: sprint-015, sprint-016 Jun 27, 2024
@maaikelimper maaikelimper modified the milestones: sprint-016, sprint-015 Jul 29, 2024
@maaikelimper
Copy link
Collaborator Author

maaikelimper commented Jul 29, 2024

@dberry given that we now have official topics for ship/buoy/etc committed to the wis2-topic-hierarchy repo:
wmo-im/wis2-topic-hierarchy@d28b8c1

could you please assist making the appropriate new templates for the new topics in wis2box-webapp:
https://github.com/wmo-im/wis2box-webapp/tree/main/src/templates

@david-i-berry
Copy link
Member

addressed in wmo-im/wis2box-webapp#54 with addition of drifting buoy and ship templates.

@tomkralidis
Copy link
Collaborator

@maaikelimper to deploy and test/validate.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discovery metadata Discovery metadata documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

5 participants