Custom Compliance Tests

[NinekoTheCat]

Custom Compliance Tests

Why?

There are specifications clients & conduwuit support that are not included in the official compliance tests. However the main compliance repository is also a go module that can be used to create custom unofficial compliance tests.
This would make development easier and regressions less likely as to check if a feature is properly implemented we just need to write a compliance test for it once and CD-CI or your local computer can run it and see the result.

How?

There are multiple options to do this some of these include:

• Rust specific library to test matrix specs (takes long time)
• Go module for compliance tests for spec elements that have not been officially added (uses existing dependencies that have been battle-tested)
  Go module seems like the easiest and fastest way to make this work as it already fits in to an existing pattern.

Resources that could be helpful

https://github.com/matrix-org/complement/blob/main/OUT-OF-REPO-TESTS.md