HDX Scraper outputs

[UGA-ITOSHumanitarianGIS]

another output was created to return all datasets

/api/v1/locations/pull

this output is designed to show locations (i.e) Ethiopia and the versions for that location and theme. So there may be more than one dataset returned with the associated resources by version.

This is being tested. HDX currently shows all resources regardless of version in one dataset per location as resources define the range of the dataset years and resources may have more than one version in a dataset. The COD Services API allows for versions of datasets as well, which allows for different sources and contributors or licensing or other elements to change among versions should there be additional resources for a dataset that do not match that of the existing COD metadata.

The additional output allows for this view representation to show in the output while retaining the /api/v1/locations/all to show the COD Services api datasets according to all resources versions to a location and theme.

[UGA-ITOSHumanitarianGIS]

The new output was implemented 31 Jan 2022

[UGA-ITOSHumanitarianGIS]

The hdxscraper output was updated so that resources from datasets modeled in the API as different versions of the same location are merged and the original dataset is retained.

[UGA-ITOSHumanitarianGIS]

Update production with scraper output union of resources of all datasets at a location for a theme to remove duplicates (EMF) files for example