wis2box 1.0.0rc1 released

[tomkralidis]

This is the first Release Candidate of wis2box 1.0.0. This release is considered feature complete and under consideration for the final 1.0.0 release. This release adds improvements to updating wis2box installations, numerous bug fixes and updates for WIS2 compliance in support of stabilizing the codebase.

Users are strongly encouraged to update to this release for WIS2 compliance.

When updating from 1.0b8 users can preserve their configuration for stations and datasets. Updating from older releases will require a clean start. See the migration notes below for more details

Enhancements/updates

• SFTP support for data ingestion
• improve support for custom csv2bufr mapping templates
• new UI customization options to configure logo and color: see https://docs.wis2box.wis.wmo.int/en/latest/reference/configuration.html#web-application
• update to latest bufr2geojson JSON schema changes
• enable image-updates; wis2box-ctl.py update using VERSION.txt
• docs
  • update to CAP publishing
  • update OS recommendations
  • update csv2bufr
• update GRIB/BUFR media types
• add CI for Trivy scanning
• fix station station links in API
• handle API 404 errors
• update ES and MinIO settings
• add environment variable to enable/disable CAP signature checking
• update storage management
• remove data movement to archive bucket
• separate retention periods for API and MinIO using WIS2BOX_STORAGE_DATA_RETENTION_DAYS and WIS2BOX_STORAGE_API_RETENTION_DAYS

Bug fixes

• safeguard empty data mappings

New installations

Please follow the instructions provided at https://docs.wis2box.wis.wmo.int/en/1.0.0rc1/user/getting-started.html

Migrating existing installations

Users running versions earlier than 1.0b8 should prune wis2box volumes and images and re-configure wis2box.

python3 wis2box.ctl stop
docker volume prune -a
docker image prune -a
cd ../

Then proceed with instructions at:
https://docs.wis2box.wis.wmo.int/en/1.0.0rc1/user/setup.html

Updating from 1.0b8

Users updating from wis2box-1.0b8 do not need to prune volumes but will be required to perform data migrations to retain previously published data in the API backend.

To update please perform the following steps:

python3 wis2box.ctl stop
docker image prune -a
cd ../

Download the new archive, copy your old wis2box.env and restart:

wget https://github.com/wmo-im/wis2box/releases/download/1.0.0rc1/wis2box-setup-1.0.0rc1.zip
unzip wis2box-setup-1.0.0rc1.zip
cd wis2box-1.0.0rc1
cp ../wis2box-1.0b8/wis2box.env .
python3 wis2box-ctl.py start

Upon start you will receive the following prompt:

No docker-compose.images-*.yml files found, creating one
Current version=Undefined, latest version=1.0.0rc1
Would you like to update ? (y/n/exit)

Select y to continue with the download of images and wait until services are started:

Check if you previous wis2box URL shows your existing datasets before proceeding. This may take some time.

To run migrations first login to the wis2box container:

python3 wis2box-ctl.py login

Then run the following command to recreate data collections in the API backend and re-process last 2 days of data:

python3 /app/migrations/1.0b8_to_1.0.0rc1/update_data_collections.py --days-to-backfill 2

Wait for the command to complete then exit the container:

exit

Documentation

Documentation for this release is available at https://docs.wis2box.wis.wmo.int/en/1.0.0rc1

Feedback

All contributions are always welcome. Feedback is welcome via GitHub issues or discussions.

The wis2box team

https://docs.wis2box.wis.wmo.int

---

This discussion was created from the release 1.0.0rc1.