v1.1.3

README: If upgrading from v1.1.1 or below, a clean installation will be required. This includes cleaning all existing Docker images. Please run the following command before upgrading: sudo docker system prune -a (this may take some time)

Bug fixes

#292 Missing exception for TLS 1.2 server test

v1.1.2

README: When upgrading to v1.1.2, a clean installation of Testrun must be performed. This includes cleaning all existing Docker images. Please run the following command before upgrading: sudo docker system prune -a (this may take some time)

This patch release brings a number of bug fixes and improvements to Testrun.

Improvements

• PDF report now has accessibility friendly headings for navigation
• Security card score increased through pinning dependencies

Bug fixes

• #241 Test module logs are now available in module.log
• #235 TLS client v1.2 test now detects outbound non-TLS connections

v1.1.1

This patch release brings a number of bug fixes and user interface improvements to Testrun.

Improvements:

• Added a guide to assist users in identifying the correct network interfaces
• Improved support for screen readers
• Improved design of history page when no results are available
• Breadcrumbs have now been removed from the runtime page
• Download report button now appears on Testrun page once Testrun completed

Bug fixes:

• #209 system.json (configuration file) is now editable by your user account
• #150 MAC address of devices in device repository can now be updated
• #132 Error message if Testrun fails to start the user interface
• #159 oui.txt download errors should now be reduced
• #206 Loading animation no longer appears above settings panel when Testrun is in progress
• #221 Resolved bug with long lease time in connection module
• #149 Warning that packet capture file cut short now removed
• #220 Better error handling when Testrun fails to get the latest version available

v1.1

The official launch of Testrun - a testing framework designed to automate verification of network-based device behavior. This release delivers a number of user experience, accessibility and functionality improvements. See below for a full list of changes:

New features

• Built in version update checking
• New Testrun status for the monitoring and startup period
• First time user experience improved

Feature improvements

• Ability to delete a device from your repository
• Delete report action in history table
• Invalid network interfaces removed from settings menu
• The side menu can now expand
• Create device modal MAC address format placeholder

Minor improvements

• Improved accuracy in IPv6 tests
• More detailed user documentation
• Stops the virtual network between test attempts
• Improved handling of test module errors
• Better handling of error messages
• Loading animations on API calls
• Quicker test cancelling

Bug fixes

• Fixed test descriptions in connection module
• Adds default test result descriptions if none are provided

Thank you for using Testrun. Please remember that support is available by raising a bug report, feature request or general issue at https://github.com/google/testrun/issues.

v1.0.3

This release is a hotfix that resolves the following bugs:

• #168
• #144
• Disables the baseline module by default
• Adds default test result descriptions
• Removes duplicate reports in the history page

v1.0.2

This release is a hotfix that resolves the following bugs:

• #140 UI does not react to waiting for device timeout
• #144 Logging output of test modules is in wrong timezone
• #147 Description in PDF report is the test description not the result description
• #155 Bug in connection.single_ip test
• Cancelled state appears if stop button is pressed
• Remove outdated device configuration guide
• Adds device DHCP pre-req to README
• Details how to configure a device to achieve a compliant result
• Inform users that device should be powered off before starting testrun
• Adds uninstall instructions and uninstall scripts
• Remove use of runtime, run infinitely until user stops Testrun
• Removes duplicate docs in connection test module
• Fix PDF report url

v1.0.1

Fixes the following bugs:

• Report URL is missing in report.json
• Total test count is double actual value
• Firmware version is not present in report or history table
• Test list and count is not reset when testing a second device

v1.0

The first official release of Testrun. Features include:

• Simple and intuitive user interface
• A range of automated tests
• HTTP/JSON API available
• Reporting in JSON and PDF

v0.4-beta

This release introduces a user interface and improved reporting.

New Features:

• User interface
• PDF and HTML report output

v0.3-beta

This release introduces a REST API, improvements of network service management and 7 new tests

New Features:

• New API available

New Tests:

• connection.dhcp_address
• connection.private_address
• ntp.network.ntp_support
• ntp.network.from_dhcp
• connection.ipv6_slaac
• connection.ipv6_ping