From 618c6a0d91cce30aa2926f814be6f85720fc046d Mon Sep 17 00:00:00 2001 From: ashish-jabble Date: Mon, 12 Sep 2022 13:45:29 +0530 Subject: [PATCH 1/5] GUI version history for 2.0 Signed-off-by: ashish-jabble --- docs/91_version_history.rst | 23 ++++++++++++++++++++++- 1 file changed, 22 insertions(+), 1 deletion(-) diff --git a/docs/91_version_history.rst b/docs/91_version_history.rst index 78185b0c5..d36809ff7 100644 --- a/docs/91_version_history.rst +++ b/docs/91_version_history.rst @@ -75,10 +75,31 @@ Release Date: 2022-08-03 - New Features: - + - A new *Developer* item has been added to the user interface to allow for the management of Python packages via the UI. This is enabled by turning on developer features in the user interface *Settings* page. + - A control has been added that allows the display of assets in the *South* screen to be collapsed or expanded. This allows for more services to be seen when services ingest multiple assets. + - A new feature has been added to the south page that allows the relationship between an asset and a service to be deprecated. This is a special feature enabled with the Developer Features option. See the documentation on building pipelines for a full description. + - A new feature has been added to the Assets and Readings page that allows for manual purging of named assets or all assets. This is a developer only feature and should not be used on production systems. The feature is enabled, along with other developer features via the Settings page. + - A new feature has been added to the South and North pages for each service that allows the user to view, import, export and delete the data persisted by a plugin. This is a developer only feature and should not be used on production systems. It is enabled via the Setting page. + - A new configuration type, Access Control List, is now supported ints user interface. This allows for selection of an ACL from those already created. + - A new tabbed layout has been adopted for the editing of south and north services and tasks. Configuration, Advanced and Security tabs are supported as our tabs for developer features if enabled. + - The user interface for displaying system logs has been modify to improve the performance of log viewing. + - The User Interface has been updated to use the latest versions of a number of packages it depends upon in due to vulnerabilities reported in those packages. + - The new FogLAMP Bucket Storage service in now included in the service status display on the GUI. + - With the introduction of image data types to the readings supported by the system the user interface has been updated to add visualisation features for these images. A new feature also allows the latest reading for a given asset to be shown. + - A new feature has been added to the south and north pages that allows the user to view the logs for the service. + - The service status display now includes the Control Dispatcher service if it has been installed. + - The user interface now supports the new control dispatcher service. This includes the graphical creation and editing of control scripts and access control lists used by control features. + - An option has been added to the Asset and Readings page to show just the latest values for a given asset. + - The notification user interface now links to the relevant sections of the online documentation allowing users to navigate to the help based on the current context. + - Some timezone inconsistencies in the user interface have been resolved. - Bug Fix: + - An issue that would cause the GUI to not always allow JSON data to be saved has been resolved. + - An issue with the auto refresh in the systems log page that made selecting the service to filter difficult has been resolved. + - The sorting of services and tasks in the South and North pages has been improved such that enabled services appear above disabled services. + - An issue the prevented gaps in the data from appearing int he groans displayed by the GUI has now been resolved. + - Entering times in the GUI could sometimes be difficult and result in unexpected results. This has now been improved to ease the entry of time values. - **Plugins** From e1c0e3305337725f5aefa286867f07ad50c18e06 Mon Sep 17 00:00:00 2001 From: ashish-jabble Date: Mon, 12 Sep 2022 15:15:09 +0530 Subject: [PATCH 2/5] Plugins version history for v2.0 Signed-off-by: ashish-jabble --- docs/91_version_history.rst | 33 ++++++++++++++++++++++----------- 1 file changed, 22 insertions(+), 11 deletions(-) diff --git a/docs/91_version_history.rst b/docs/91_version_history.rst index d36809ff7..ea8cbcb55 100644 --- a/docs/91_version_history.rst +++ b/docs/91_version_history.rst @@ -106,33 +106,44 @@ Release Date: 2022-08-03 - New Features: - - A new OPCUA South Plugin has been created based on the Open 62541 OPCUA client library - - The documentation has been updated to include the new watchdog notification rule. - - A new notification delivery plugin has been added that allows notifications to be delivered via the control dispatcher service. This allows the full features of the control dispatcher to be used with the edge notification path. - - Documentation has been added for the Azure north plugin - - The fledge-north-harperdb plugin was not previously documented. Documentation for this plugin has now been added to the system. + - A new notification delivery fledge-notify-control plugin has been added that allows notifications to be delivered via the control dispatcher service. This allows the full features of the control dispatcher to be used with the edge notification path. - Support has been added for proxy servers in the north HTTP-C plugin. - The OPCUA north plugin has been updated to include the ability for systems outside of Fledge to write to the server that Fledge advertises. These write are taken as control input into the Fledge system. - The HTTPC North plugin has been enhanced to add an optional Python script that can be used to format the payload of the data sent in the HTTP REST request. - - The documentation describing how to run services under the debugger has been improved along with other improvements to the documentation aimed at plugin developers. - - +underlined text+ - The SQLite storage plugins have been updated to support service extension schemas. This is a mechanism that allows services within the Fledge system to add new schemas within the storage service that are exclusive to that service. + - The Python35 filter has been updated to use the common Python interpreter. This allows for packages such as numpy to be used. The resilience and error reporting of this plugin have also been improved. + - A set of developer only features designed to aid the process of developing data pipelines and plugins has been added in this release. These features are turned on and off via a toggle setting on the Settings page. + - A new option has been added to the Python35 filter that changes the way datapoint names are used in the JSOn readings. Previously there had to be encoded and decode by use of the b’xxx' mechanism. There is now a toggle that allows for either this to be required or simple text string use to be enabled. + - The API of the storage service has been updated to allow for custom schemas to be created by services that extend the core functionality of the system. + - New image type datapoints can now be sent between instances using the http north and south plugins. + - A new watchdog notification rule plugin has been added that allows notifications to be send if data stops being ingress for specified assets. + - The ability to define response headers in the http south plugin has been added to aid certain circumstances where CORS provided data flows. - The documentation of the Python35 filter has been updated to included a fuller description of how to make use of the configuration data block supported by the plugin. - - Documentation has been added for the Video4Linux plugin + - The documentation describing how to run services under the debugger has been improved along with other improvements to the documentation aimed at plugin developers. + - Documentation has been added for the Azure north plugin. + - Documentation has now been added for fledge-north-harperdb. + - Documentation has been added for the Video4Linux plugin. + - Documentation has been added for the custom asset notification plugin. + - The documentation has been updated to include the new watchdog notification rule. - Bug Fix: - - Build procedures were updated to accommodate breaking changes in the S2OPC OPCUA Toolkit + - Build procedures were updated to accommodate breaking changes in the S2OPC OPCUA Toolkit. - Occasionally switching from the sqlite to the sqlitememory plugin for the storage of readings would cause a fatal error in the storage layer. This has now been fixed and it is possible to change to sqlitememory without an error. - A race condition within the modbus south plugin that could cause unfair scheduling of read verses write operations has been resolved. This could cause write operations to be delayed in some circumstances. The scheduling of set point write operations is now fairly interleaved between the read operations in all cases. - A problem that caused the HTTPC North plugin to fail if the path component of the URL was omitted has been resolved. - The modbus-c south plugin documentation has been enhanced to include details of the function codes used to read modbus data. - An incorrect error message in the modbus-c south plugin has been fixed and others have been improved to aid resolving configuration issues. The documentation has been updated to include descriptive text for the error messages that may occur. - - The documentation for the Python35 filter has been updated to discuss Python package imports and issues when removing previously used imports. - The Python35 filter plugin has been updated such that if no data is to be passed onwards it may now simply return the None Python constant or an empty list. - The Python35 plugin which allows simple Python scripts to be added into filter pipelines has had a number of updates to improve the robustness of the plugin in the event of incorrect script code being provided by the user. The behaviour of the plugin has also been updated such that any errors run the script will prevent data being passed onwards the filter pipeline. - - The \Average\ rule has been updated to improve the user interaction during the configuration of the rule. + - The Average rule has been updated to improve the user interaction during the configuration of the rule. + - The first time a plugin that persisted data is executed erroneous errors and warnings would be written to the system log. This has now been resolved. + - Python35 filter code that failed to return a properly formed asset in the response would previously crash rather than fail gracefully. An error explaining the exact cause of the failure is now logged in the system log. + - An issue with the Kafka north plugin not sending data in certain circumstances has been resolved. + - Adding some notification plugins would cause incorrect errors to be logged to the system log. The functioning of the notifications was not affected. This has now been resolved and the error logs no longer appear. + - The documentation for the fledge-rule-delta plugin has been corrected. + - The documentation for the Python35 filter has been updated to discuss Python package imports and issues when removing previously used imports. Fledge v1 From f07713018f1ec30299f14491422a83cbc77f6514 Mon Sep 17 00:00:00 2001 From: ashish-jabble Date: Mon, 12 Sep 2022 15:19:55 +0530 Subject: [PATCH 3/5] Fledge core version history for v2.0 Signed-off-by: ashish-jabble --- docs/91_version_history.rst | 61 ++++++++++++++++++++++++++++++++----- 1 file changed, 53 insertions(+), 8 deletions(-) diff --git a/docs/91_version_history.rst b/docs/91_version_history.rst index ea8cbcb55..838f5665b 100644 --- a/docs/91_version_history.rst +++ b/docs/91_version_history.rst @@ -35,30 +35,66 @@ Release Date: 2022-08-03 - New Features: - Add options for choosing the Fledge Asset name: Browser Name, Subscription Path and Full Path. Use the OPC UA Source timestamp as the User Timestamp in Fledge. - - A new section has been added to the documentation which discusses the process and best practices for building data pipelines in Fledge. - The storage interface used to query generic configuration tables has been improved to support tests for null and non-null column values. - The ability for north services to support control inputs coming from systems north of Fledge has been introduced. - - Improved north plugin developers documentation is now available. - The handling of a failed storage service has been improved. The client now attempt to re-connect and if that fails they we will down. The logging produced is now much less verbose, removing the repeated messages previously seen. - - Documentation has been added for the purge process and the new options recently added. - A new service has been added to Fledge to facilitate the routing of control messages within Fledge. This service is responsible for determined which south services to send control requests to and also for the security aspects of those requests. - - Updated OMF North plugin documentation to include current OSIsoft product names - Ensure that new Fledge data types not supported by OMF are not processed. - - Fixed a typo in the quick start guide - - Added an article on Developing with Windows Subsystem for Linux (WSL2) to the Plugin Developer Guide. WSL2 allows you to run a Linux environment directly on Windows without the overhead of Windows Hyper-V. You can run Fledge and develop plugins on WSL2. - The storage service now supports a richer set of queries against the generic table interface. In particular joins between tables are now supported. - OPC UA Security has been enhanced. This plugin now supports Security Policies Basic256 and Basic256Sha256, with Security Modes Sign and Sign & Encrypt. Authentication types are anonymous and username/password. - South services that have a slow poll rate can take a long time to shutdown, this sometimes resulted in those services not shutting down cleanly. The shutdown process has been modified such that these services now shutdown promptly regardless of polling rate. - - The documentation that describes the writing of asynchronous Python plugins has been updated in line with the latest code changes. + - A new configuration item type has been added for the selection of access control lists. + - Support has been added to the Python query builder for NULL and NOT NULL columns. + - The Python query builder has been updated to support nested database queries. + - The third party packages on which Fledge is built have been updated to use the latest versions to resolve issues with vulnerabilities in these underlying packages. + - When the data stream from a south plugin included an OMF Hint of AFLocation, performance of the OMF North plugin would degrade. In addition, process memory would grow over time. These issues have been fixed. + - The version of the PostgreSQL database used by the Postgres storage plugin has been updated to PostgreSQL 13. + - An enhancement has been added to the North service to allow the user to specify the block size to use when sending data to the plugin. This helps tune the north services and is described in the tuning guide within the documentation. + - The notification server would previously output warning messages when it was starting, these were not an indication of a problem and should have been information messages. This has now been resolved. + - The backup mechanism has been improved to include some external items to be include in the backup and provide a more secure backup. + - The purge option that controls if unsent assets cane purged or not has been enhanced to provide options for sent to any destination or sent to all destinations as well as sent to no destinations. + - It is now possible to add control features to Python south plugins. + - Certificate based authentication is now possible between services in a single instance. This allows for secure control messages to be implemented between services. + - Performance improvements have been made such that the display of south service data when large numbers of assets are in use has been improved. + - The new micro service, control dispatcher, is now available as a package that can be installed via the package manager. + - New data types are now supported for data points within an asset and are encoded into various Python types when passed to Python plugins or scripts run within standard plugin. This includes numpy arrays for images and data buffers, 2 dimensional Python lists and others. Details of the type encoding can be found in the plugin developers guide of the online product documentation. + - The mechanism for online update of configuration has been extended to allow for more configuration to be modified without the need to restart any services. + - Support has been added for the Raspberry Pi Bullseye release. + - A problem with a file descriptor leak in Python that could cause Fledge to fail has been resolved. + - The control of logging levels has now been added to the Python code run within a service such that the advanced settings option is now honoured by the Python code. + - Enhancements have been made to the asset tracker API to retrieve the service responsive for the ingest of a given asset. - A new API has been added to allow external viewing and managing of the data that various plugins persist. - A new REST API entry point has been added that allows all instances of a specified asset to be purged from the buffer. A further entry point has also been added to purge all data from the reading buffer. These entry points should be used with care as they will cause data to be discarded. + - A new parameter has been added to the asset retrieval API that allows image data to be returned, images=include. By default image type datapoints will be replaced with a message, “Image removed for brevity”, in order to reduce the size of the returned payload. + - A new API has been added to the management API that allows services to request that URL’s in the public API are proxied to the service API. This is used when extending the functionality of the system with custom microservices. + - A new set of API calls have been added to the public REST API of the product to support the control dispatcher and for the creation and management of control scripts. + - A new API call has been added to Fledge that allows the core package to be updated and Fledge restarted with the updated version. + - A new API has been added to the public API that will return the latest reading for a given asset. This will return all data types including images. + - A new API has been added that allows asset tracking records to be marked as deprecated. This allows the flushing of relationships between assets and the services that have processed them. It is useful only in development systems and should not be used in production systems. + - A new API call has been added that allows the persisted data related to a plugin to be retrieved via the public REST API. The is intended for use by plugin writers and to allow for better tracking of data persisted between service executions. + - A new query parameter has been added to the API used to fetch log messages from the system log, nontotals. This will increase the performance of the call at the expense of not returning the total number of logs that match the search criteria. + - New API entry points have been added for the management of Python packages. + - Major performance improvements have been made to the code for retrieving log messages from the system log. This is mainly an issue on systems with very large log files. + - The storage service API has been extended to support the creation of private schemas for the use of optional micro services registered to a Fledge instance. + - Filtering by service type has now been added to the API that retrieve service information via the public REST API. - A number of new features have been added to the user interface to aid developers creating data pipelines and plugins. These features allow for manual purging of data, deprecating the relationship between the services and the assets they have ingested and viewing the persisted data of the plugins. These are all documented in the section on developing pipelines within the online documentation. + - A new section has been added to the documentation which discusses the process and best practices for building data pipelines in Fledge. - A glossary has been added to the documentation for the product. + - The documentation that describes the writing of asynchronous Python plugins has been updated in line with the latest code changes. - The documentation has been updated to reflect the new tabs available in the Fledge user interface for editing the configuration of services and tasks. - A new introduction section has been added to the Fledge documentation that describes the new features and some typical use cases of Fledge. - A new section has been added to the Fledge Tuning guide that discusses the tuning of North services and tasks. Also scheduler tuning has been added to the tuning guide along with the tuning of the service monitor which is used to detected failures of services within Fledge. - The Tuning Fledge section of the documentation has been updated to include information on tuning the Fledge service monitor that is used to monitor and restart Fledge services. A section has also been added that describes the tuning of north services and tasks. A new section describes the different storage plugins available, when they should be used and how to tune them. - + - Added an article on Developing with Windows Subsystem for Linux (WSL2) to the Plugin Developer Guide. WSL2 allows you to run a Linux environment directly on Windows without the overhead of Windows Hyper-V. You can run Fledge and develop plugins on WSL2. + - Documentation has been added for the purge process and the new options recently added. + - Documentation has been added to the plugin developer guides that explain what needs to be done to allow the packaging mechanism to be able to package a plugin. + - Documentation has been added to the Building Pipelines section of the documentation for the new UI feature that allows Python packages to be installed via the user interface. + - Documentation has been updated to show how to build Fledge using the requirements.sh script. + - The documentation ordering has been changed to make the section order more logical. + - The plugin developers guide has been updated to include information on the various flags that are used to communicate the options implemented by a plugin. + - Updated OMF North plugin documentation to include current OSIsoft product names. + - Fixed a typo in the quick start guide. + - Improved north plugin developers documentation is now available. - Bug Fix: @@ -69,6 +105,15 @@ Release Date: 2022-08-03 - The diagnostics when a plugin fails to load have been improved. - The South Plugin shutdown problem was caused by errors in the plugin startup procedure which would throw an exception for any error. The plugin startup has been fixed so errors are reported properly. The problem of plugin shutdown when adding a filter has been resolved. - The S2OPCUA South Plugin would throw an exception for any error during startup. This would cause the core system to shut down the plugin permanently after a few retries. This has been fixed. Error messages has been recategorized to properly reflect informational, warning and error messages. + - The update process has been optimised to remove an unnecessary restart if no new version of the software are available. + - The OMF North plugin was unable to process configuration changes or shut down if the PI Web API hostname was not correct. This has been fixed. + - S2OPC South plugin builds have been updated to explicitly reference S2OPC Toolkit Version 1.2.0. + - An issue that could on rare occasions cause the SQLite plugin to silently discard a readings has been resolved. + - An issue with the automatic renewal of authentication certificates has been resolved. + - Deleting a service which had a filter pipeline could cause some orphaned configuration information to be left stored. This prevented creating filters of the same name in the future. This has now been resolved. + - The error reporting has been improved when downloading backups from the system. + - An issue that could cause north plugins to occasionally fail to shutdown correctly has now been resolved. + - The documentation has been updated to correct a statement regarding running the south side as a task. - **GUI** From b74d26317c3aa9f90d534c69ee683af902f4ebcd Mon Sep 17 00:00:00 2001 From: ashish-jabble Date: Mon, 12 Sep 2022 18:11:18 +0530 Subject: [PATCH 4/5] minor fixes Signed-off-by: ashish-jabble --- docs/91_version_history.rst | 33 ++++++++++++++++----------------- 1 file changed, 16 insertions(+), 17 deletions(-) diff --git a/docs/91_version_history.rst b/docs/91_version_history.rst index 838f5665b..db495fc44 100644 --- a/docs/91_version_history.rst +++ b/docs/91_version_history.rst @@ -28,7 +28,7 @@ Fledge v2 v2.0.0 ------- -Release Date: 2022-08-03 +Release Date: 2022-09-09 - **Fledge Core** @@ -37,10 +37,10 @@ Release Date: 2022-08-03 - Add options for choosing the Fledge Asset name: Browser Name, Subscription Path and Full Path. Use the OPC UA Source timestamp as the User Timestamp in Fledge. - The storage interface used to query generic configuration tables has been improved to support tests for null and non-null column values. - The ability for north services to support control inputs coming from systems north of Fledge has been introduced. - - The handling of a failed storage service has been improved. The client now attempt to re-connect and if that fails they we will down. The logging produced is now much less verbose, removing the repeated messages previously seen. - - A new service has been added to Fledge to facilitate the routing of control messages within Fledge. This service is responsible for determined which south services to send control requests to and also for the security aspects of those requests. + - The handling of a failed storage service has been improved. The client now attempt to re-connect and if that fails they will down. The logging produced is now much less verbose, removing the repeated messages previously seen. + - A new service has been added to Fledge to facilitate the routing of control messages within Fledge. This service is responsible for determining which south services to send control requests to and also for the security aspects of those requests. - Ensure that new Fledge data types not supported by OMF are not processed. - - The storage service now supports a richer set of queries against the generic table interface. In particular joins between tables are now supported. + - The storage service now supports a richer set of queries against the generic table interface. In particular, joins between tables are now supported. - OPC UA Security has been enhanced. This plugin now supports Security Policies Basic256 and Basic256Sha256, with Security Modes Sign and Sign & Encrypt. Authentication types are anonymous and username/password. - South services that have a slow poll rate can take a long time to shutdown, this sometimes resulted in those services not shutting down cleanly. The shutdown process has been modified such that these services now shutdown promptly regardless of polling rate. - A new configuration item type has been added for the selection of access control lists. @@ -51,11 +51,11 @@ Release Date: 2022-08-03 - The version of the PostgreSQL database used by the Postgres storage plugin has been updated to PostgreSQL 13. - An enhancement has been added to the North service to allow the user to specify the block size to use when sending data to the plugin. This helps tune the north services and is described in the tuning guide within the documentation. - The notification server would previously output warning messages when it was starting, these were not an indication of a problem and should have been information messages. This has now been resolved. - - The backup mechanism has been improved to include some external items to be include in the backup and provide a more secure backup. - - The purge option that controls if unsent assets cane purged or not has been enhanced to provide options for sent to any destination or sent to all destinations as well as sent to no destinations. + - The backup mechanism has been improved to include some external items in the backup and provide a more secure backup. + - The purge option that controls if unsent assets can be purged or not has been enhanced to provide options for sent to any destination or sent to all destinations as well as sent to no destinations. - It is now possible to add control features to Python south plugins. - Certificate based authentication is now possible between services in a single instance. This allows for secure control messages to be implemented between services. - - Performance improvements have been made such that the display of south service data when large numbers of assets are in use has been improved. + - Performance improvements have been made such that the display of south service data when large numbers of assets are in use. - The new micro service, control dispatcher, is now available as a package that can be installed via the package manager. - New data types are now supported for data points within an asset and are encoded into various Python types when passed to Python plugins or scripts run within standard plugin. This includes numpy arrays for images and data buffers, 2 dimensional Python lists and others. Details of the type encoding can be found in the plugin developers guide of the online product documentation. - The mechanism for online update of configuration has been extended to allow for more configuration to be modified without the need to restart any services. @@ -68,7 +68,6 @@ Release Date: 2022-08-03 - A new parameter has been added to the asset retrieval API that allows image data to be returned, images=include. By default image type datapoints will be replaced with a message, “Image removed for brevity”, in order to reduce the size of the returned payload. - A new API has been added to the management API that allows services to request that URL’s in the public API are proxied to the service API. This is used when extending the functionality of the system with custom microservices. - A new set of API calls have been added to the public REST API of the product to support the control dispatcher and for the creation and management of control scripts. - - A new API call has been added to Fledge that allows the core package to be updated and Fledge restarted with the updated version. - A new API has been added to the public API that will return the latest reading for a given asset. This will return all data types including images. - A new API has been added that allows asset tracking records to be marked as deprecated. This allows the flushing of relationships between assets and the services that have processed them. It is useful only in development systems and should not be used in production systems. - A new API call has been added that allows the persisted data related to a plugin to be retrieved via the public REST API. The is intended for use by plugin writers and to allow for better tracking of data persisted between service executions. @@ -83,7 +82,7 @@ Release Date: 2022-08-03 - The documentation that describes the writing of asynchronous Python plugins has been updated in line with the latest code changes. - The documentation has been updated to reflect the new tabs available in the Fledge user interface for editing the configuration of services and tasks. - A new introduction section has been added to the Fledge documentation that describes the new features and some typical use cases of Fledge. - - A new section has been added to the Fledge Tuning guide that discusses the tuning of North services and tasks. Also scheduler tuning has been added to the tuning guide along with the tuning of the service monitor which is used to detected failures of services within Fledge. + - A new section has been added to the Fledge Tuning guide that discusses the tuning of North services and tasks. Also scheduler tuning has been added to the tuning guide along with the tuning of the service monitor which is used to detect failures of services within Fledge. - The Tuning Fledge section of the documentation has been updated to include information on tuning the Fledge service monitor that is used to monitor and restart Fledge services. A section has also been added that describes the tuning of north services and tasks. A new section describes the different storage plugins available, when they should be used and how to tune them. - Added an article on Developing with Windows Subsystem for Linux (WSL2) to the Plugin Developer Guide. WSL2 allows you to run a Linux environment directly on Windows without the overhead of Windows Hyper-V. You can run Fledge and develop plugins on WSL2. - Documentation has been added for the purge process and the new options recently added. @@ -92,7 +91,7 @@ Release Date: 2022-08-03 - Documentation has been updated to show how to build Fledge using the requirements.sh script. - The documentation ordering has been changed to make the section order more logical. - The plugin developers guide has been updated to include information on the various flags that are used to communicate the options implemented by a plugin. - - Updated OMF North plugin documentation to include current OSIsoft product names. + - Updated OMF North plugin documentation to include current OSIsoft (AVEVA) product names. - Fixed a typo in the quick start guide. - Improved north plugin developers documentation is now available. @@ -108,11 +107,12 @@ Release Date: 2022-08-03 - The update process has been optimised to remove an unnecessary restart if no new version of the software are available. - The OMF North plugin was unable to process configuration changes or shut down if the PI Web API hostname was not correct. This has been fixed. - S2OPC South plugin builds have been updated to explicitly reference S2OPC Toolkit Version 1.2.0. - - An issue that could on rare occasions cause the SQLite plugin to silently discard a readings has been resolved. + - An issue that could on rare occasions cause the SQLite plugin to silently discard readings has been resolved. - An issue with the automatic renewal of authentication certificates has been resolved. - Deleting a service which had a filter pipeline could cause some orphaned configuration information to be left stored. This prevented creating filters of the same name in the future. This has now been resolved. - The error reporting has been improved when downloading backups from the system. - An issue that could cause north plugins to occasionally fail to shutdown correctly has now been resolved. + - Some fixes are made in Package update API that allows the core package to be updated. - The documentation has been updated to correct a statement regarding running the south side as a task. @@ -125,11 +125,10 @@ Release Date: 2022-08-03 - A new feature has been added to the south page that allows the relationship between an asset and a service to be deprecated. This is a special feature enabled with the Developer Features option. See the documentation on building pipelines for a full description. - A new feature has been added to the Assets and Readings page that allows for manual purging of named assets or all assets. This is a developer only feature and should not be used on production systems. The feature is enabled, along with other developer features via the Settings page. - A new feature has been added to the South and North pages for each service that allows the user to view, import, export and delete the data persisted by a plugin. This is a developer only feature and should not be used on production systems. It is enabled via the Setting page. - - A new configuration type, Access Control List, is now supported ints user interface. This allows for selection of an ACL from those already created. + - A new configuration type, Access Control List, is now supported in user interface. This allows for selection of an ACL from those already created. - A new tabbed layout has been adopted for the editing of south and north services and tasks. Configuration, Advanced and Security tabs are supported as our tabs for developer features if enabled. - - The user interface for displaying system logs has been modify to improve the performance of log viewing. - - The User Interface has been updated to use the latest versions of a number of packages it depends upon in due to vulnerabilities reported in those packages. - - The new FogLAMP Bucket Storage service in now included in the service status display on the GUI. + - The user interface for displaying system logs has been modified to improve the performance of log viewing. + - The User Interface has been updated to use the latest versions of a number of packages it depends upon, due to vulnerabilities reported in those packages. - With the introduction of image data types to the readings supported by the system the user interface has been updated to add visualisation features for these images. A new feature also allows the latest reading for a given asset to be shown. - A new feature has been added to the south and north pages that allows the user to view the logs for the service. - The service status display now includes the Control Dispatcher service if it has been installed. @@ -163,7 +162,7 @@ Release Date: 2022-08-03 - New image type datapoints can now be sent between instances using the http north and south plugins. - A new watchdog notification rule plugin has been added that allows notifications to be send if data stops being ingress for specified assets. - The ability to define response headers in the http south plugin has been added to aid certain circumstances where CORS provided data flows. - - The documentation of the Python35 filter has been updated to included a fuller description of how to make use of the configuration data block supported by the plugin. + - The documentation of the Python35 filter has been updated to include a fuller description of how to make use of the configuration data block supported by the plugin. - The documentation describing how to run services under the debugger has been improved along with other improvements to the documentation aimed at plugin developers. - Documentation has been added for the Azure north plugin. - Documentation has now been added for fledge-north-harperdb. @@ -176,7 +175,7 @@ Release Date: 2022-08-03 - Build procedures were updated to accommodate breaking changes in the S2OPC OPCUA Toolkit. - Occasionally switching from the sqlite to the sqlitememory plugin for the storage of readings would cause a fatal error in the storage layer. This has now been fixed and it is possible to change to sqlitememory without an error. - - A race condition within the modbus south plugin that could cause unfair scheduling of read verses write operations has been resolved. This could cause write operations to be delayed in some circumstances. The scheduling of set point write operations is now fairly interleaved between the read operations in all cases. + - A race condition within the modbus south plugin that could cause unfair scheduling of read versus write operations has been resolved. This could cause write operations to be delayed in some circumstances. The scheduling of set point write operations is now fairly interleaved between the read operations in all cases. - A problem that caused the HTTPC North plugin to fail if the path component of the URL was omitted has been resolved. - The modbus-c south plugin documentation has been enhanced to include details of the function codes used to read modbus data. - An incorrect error message in the modbus-c south plugin has been fixed and others have been improved to aid resolving configuration issues. The documentation has been updated to include descriptive text for the error messages that may occur. From f1f4fa7198c90f39d1c3f53d2a9d7f44f54b9bfb Mon Sep 17 00:00:00 2001 From: ashish-jabble Date: Mon, 12 Sep 2022 19:42:41 +0530 Subject: [PATCH 5/5] more improvements in version history in plugins section Signed-off-by: ashish-jabble --- docs/91_version_history.rst | 23 +++++++++-------------- 1 file changed, 9 insertions(+), 14 deletions(-) diff --git a/docs/91_version_history.rst b/docs/91_version_history.rst index db495fc44..e38ca7819 100644 --- a/docs/91_version_history.rst +++ b/docs/91_version_history.rst @@ -150,25 +150,24 @@ Release Date: 2022-09-09 - New Features: - - A new notification delivery fledge-notify-control plugin has been added that allows notifications to be delivered via the control dispatcher service. This allows the full features of the control dispatcher to be used with the edge notification path. + - A new fledge-notify-control plugin has been added that allows notifications to be delivered via the control dispatcher service. This allows the full features of the control dispatcher to be used with the edge notification path. + - A new fledge-notify-customasset notification delivery plugin that creates an event asset in readings. + - A new fledge-rule-delta notification rule plugin that triggers when a data point value changes. + - A new fledge-rule-watchdog notification rule plugin that allows notifications to be send if data stops being ingress for specified assets. - Support has been added for proxy servers in the north HTTP-C plugin. - The OPCUA north plugin has been updated to include the ability for systems outside of Fledge to write to the server that Fledge advertises. These write are taken as control input into the Fledge system. - The HTTPC North plugin has been enhanced to add an optional Python script that can be used to format the payload of the data sent in the HTTP REST request. - The SQLite storage plugins have been updated to support service extension schemas. This is a mechanism that allows services within the Fledge system to add new schemas within the storage service that are exclusive to that service. - The Python35 filter has been updated to use the common Python interpreter. This allows for packages such as numpy to be used. The resilience and error reporting of this plugin have also been improved. - A set of developer only features designed to aid the process of developing data pipelines and plugins has been added in this release. These features are turned on and off via a toggle setting on the Settings page. - - A new option has been added to the Python35 filter that changes the way datapoint names are used in the JSOn readings. Previously there had to be encoded and decode by use of the b’xxx' mechanism. There is now a toggle that allows for either this to be required or simple text string use to be enabled. + - A new option has been added to the Python35 filter that changes the way datapoint names are used in the JSON readings. Previously there had to be encoded and decode by use of the b’xxx' mechanism. There is now a toggle that allows for either this to be required or simple text string use to be enabled. - The API of the storage service has been updated to allow for custom schemas to be created by services that extend the core functionality of the system. - New image type datapoints can now be sent between instances using the http north and south plugins. - - A new watchdog notification rule plugin has been added that allows notifications to be send if data stops being ingress for specified assets. - The ability to define response headers in the http south plugin has been added to aid certain circumstances where CORS provided data flows. - The documentation of the Python35 filter has been updated to include a fuller description of how to make use of the configuration data block supported by the plugin. - The documentation describing how to run services under the debugger has been improved along with other improvements to the documentation aimed at plugin developers. - - Documentation has been added for the Azure north plugin. - - Documentation has now been added for fledge-north-harperdb. - - Documentation has been added for the Video4Linux plugin. - - Documentation has been added for the custom asset notification plugin. - - The documentation has been updated to include the new watchdog notification rule. + - Documentation has been added for fledge-north-azure plugin. + - Documentation has now been added for fledge-north-harperdb plugin. - Bug Fix: @@ -177,17 +176,13 @@ Release Date: 2022-09-09 - Occasionally switching from the sqlite to the sqlitememory plugin for the storage of readings would cause a fatal error in the storage layer. This has now been fixed and it is possible to change to sqlitememory without an error. - A race condition within the modbus south plugin that could cause unfair scheduling of read versus write operations has been resolved. This could cause write operations to be delayed in some circumstances. The scheduling of set point write operations is now fairly interleaved between the read operations in all cases. - A problem that caused the HTTPC North plugin to fail if the path component of the URL was omitted has been resolved. - - The modbus-c south plugin documentation has been enhanced to include details of the function codes used to read modbus data. - - An incorrect error message in the modbus-c south plugin has been fixed and others have been improved to aid resolving configuration issues. The documentation has been updated to include descriptive text for the error messages that may occur. - - The Python35 filter plugin has been updated such that if no data is to be passed onwards it may now simply return the None Python constant or an empty list. - - The Python35 plugin which allows simple Python scripts to be added into filter pipelines has had a number of updates to improve the robustness of the plugin in the event of incorrect script code being provided by the user. The behaviour of the plugin has also been updated such that any errors run the script will prevent data being passed onwards the filter pipeline. + - The modbus-c south plugin documentation has been enhanced to include details of the function codes used to read modbus data. Also incorrect error message and others have been improved to aid resolving configuration issues. The documentation has been updated to include descriptive text for the error messages that may occur. + - The Python35 filter plugin has been updated such that if no data is to be passed onwards it may now simply return the None Python constant or an empty list. Also it allows simple Python scripts to be added into filter pipelines has had a number of updates to improve the robustness of the plugin in the event of incorrect script code being provided by the user. The behaviour of the plugin has also been updated such that any errors run the script will prevent data being passed onwards the filter pipeline. An error explaining the exact cause of the failure is now logged in the system log. Also its documentation has been updated to discuss Python package imports and issues when removing previously used imports. - The Average rule has been updated to improve the user interaction during the configuration of the rule. - The first time a plugin that persisted data is executed erroneous errors and warnings would be written to the system log. This has now been resolved. - - Python35 filter code that failed to return a properly formed asset in the response would previously crash rather than fail gracefully. An error explaining the exact cause of the failure is now logged in the system log. - An issue with the Kafka north plugin not sending data in certain circumstances has been resolved. - Adding some notification plugins would cause incorrect errors to be logged to the system log. The functioning of the notifications was not affected. This has now been resolved and the error logs no longer appear. - The documentation for the fledge-rule-delta plugin has been corrected. - - The documentation for the Python35 filter has been updated to discuss Python package imports and issues when removing previously used imports. Fledge v1