Note: versioning follows Semver standard with 3 levels
The main changes are related to the possibility of a generic use of the ManGO portal for other installations with third parties and is necessary to fully open source the software stack.
A dedicated document is created in the file Custom-deployments.md which is WIP
- Generic module: basic user and group management. This plugin can be activated and enables users with a rodsadmin or groupadmin role to manage users and groups
In addition, changed various parts for Kafka indexing:
- Implementation for OpenSearch indexing must be specified, defaults to "external"
- If this value is "internal", a local indexing thread is created and listeners configured
- Some field definitions have changed
- Admin indexing actions are disabled in the view template
- Fixed metadata schema version validation code to allow more than 9 versions in any part
- Added role in user profile, yet another example of template overrides
- Fixed bug (crash) for regular users trying to view the members of a group but have no roles assigned (re-adding vanished check)
- Introduced the paradigm of "logging in into projects" besides the zones (plugin user_tantra).
- landing page displays a card for every project the current user is entitled to
- "Entering" a project means that the project's 2 main properties (name and path) are saved in the flask and irods user sessions as the active "realm"
- The sidebar menu is overriden with a plugin specific template that displays the realm name along an exit button and modifies the menu items for browsing, templates, search and group management to go direct to the realm specific pages
- Introduced support for repeatable nested composite fields of different levels for metadata schemas (as long as they are created by importing from JSON).
- Additional check for Host header in order to decide which logo to use on the data platform API landing page
- Fixed max download size in template code to match the code guard limit
- Template overrides: "always" option was not working, easy fix
- Landing page is now configurable (points a the plugins/user_tantra/realm.py route)
- Started implementing the dynamic registration of plugins via configs rather than hardcoded in the main app.py application entry point (Python importlib module)
- Bulk copy/move: subdirectories of collections with spaces in their names were not shown as possible destinations, fixed.
- Metadata schema manager: fields previously selected for deletion would be deleted every time another field was deleted, fixed.
- Refined the regular expressions in the names of metadata schema fields to prevent repetition.
- Metadata schemas can now be requested via either status or version number.
- Operator sessions bug fix: they were destroyed upon checking their validity
- Synchronous bulk download is available for data objects
- Allow copy/download bulk operations for non-owners
- changed temp upload directory to use the nfs storage given the larger upload limits could crash the container
- Added initial statistics to projects (Via Mustafa)
- Fixed bug in bulk operations: make sure a HTML id does not contain spaces (via Mariana)
- Increased download (50GiB) and upload limits (5GiB per file)
- Corrections to connection info pages (via Filip)
- Made data platform / irods sessions more robust against missing name/email openid attributes (via Peter)
- Avoid showing doubles in case metadata units are set
- Made medata schema rendering more robust, coping with units set on metadata by scripts or icommands while also being schema managed
- Fixed fatal error when sanitizing user generated metadata
- Limit size for Tika analysis to 200MB awaiting async implementation
- More statistics from OpenSearch aggregations
- Fixed bug: viewing individual data objects in the trash throws a fatal error
- Consistency in initializing variables
- Fixed bug (robustness): when a schema is missing, a fatal error shows for composite fields because the data was structured differently. Now an existence check is performed with a fallback to the older behavior.
- Multiple option for composite metadata, disabling nesting of composite fields
- Fixed validation bug in schema ids (from partial match to full match)
- Updated iRODS PRC to 1.1.8
- Updated all outdated dependencies (python modules)
The most visible new features in this release are in the metadata schema management functions
- new description field for all fields in managed schemas, saved as a "help" property in the json files
- placeholder option and validation through regular expressions for text-style fields
- schema manager: fix issue with dropdowns and radios in same session
- schema manager: fix issues with default values in single-value multiple choice
- fixed: display of user metadata (name and email from plugin handler) in profile was not working for users without home collection
- fix bug with wrong version number being annotated when editing metadata from a schema
- fixed operator plugin: delete dialogs have now a different id per zone
- fixed schema manager: strip (leading/trailing) whitespace from option values
- fixed user/manual metadata editing: strip (leading/trailing) whitespace of form edited metadata values
- fixed bug where always the published version of a schema was used to render metadata labels, now the correct (archived/published) version is used instead
- moved core admin module to plugins (where it belongs semantically), as well as remaining admin from template_overrides
- all admin routes are now protected with decorator that checks the proper user role
- checksums are displayed for data objects (via Peter)
- status field for data objects now checks the replica status (previously the native status was checked, but it is always None)
- import/export of JSON schema parts in schema editor (kernel)
- group management via operator account (plugin)
- operator (rodsadmin) zone sessions in dedicated plugin for re-use across modules
- plugin friendly modular admin section with its own sidebar, base template, .. plugins can simply register an admin index in a new mango_ui.py core module
- search index stats and collection stats from fast open search aggregations
- besides admin extensions, any other plugin can now also register a sidebar menu entry. Refactored the standard modules to make use of it. Also, the sidebar menu order is determined solely by configuration
- adopting yaml as a config format for any new features (WIP)
- if an openid definition for a user is found, the metadata for that user is updated if not set already: name and email (via new plugin "user_tantra")
- fixed crash in top search bar
- groups in user profile are sorted alphabetically
- zone name is now displayed next to the logos in the top left
- admin section has red border around sidebar menu and main content block
- new jinja2 template filters: exposing regular expressions
- OpenSearch extension now uses the common operator sessions
- admin link in sidebar only for those in the role "mango_portal_admin"
- new signal upon user session creation
- fully multi tenant towards zones
- CRUD operations on collections, data objects and metadata
- basic permission management
- metadata schema manager (with versions) and editor
- schema based metadata editing
- bulk operations on collections and data objects
- template override system, mainly geared towards views
- conversion script to transform pre 2023-04 metadata schemas to the new format