-
Notifications
You must be signed in to change notification settings - Fork 5
Home
Welcome to the Symbolic Execution-based Test Tool Evaluator (SETTE) wiki!
With the SETTE framework (not only symbolic execution-based) test input generators can be evaluated and compared. Our objective was to give a fine-grained feedback on several test generators. We collected the important features of imperative languages, implemented a set of code snippets (see sette-snippets), the test generators generated test inputs for them, and based on the results we evaluated the capabilities of the tools.
Currently, the following tools are supported by SETTE (completely automatic execution evaluation):
In addition, we have evaluated one tool manually:
- IntelliTest (formerly called Pex)
For an overview of the approach and the results see the following paper:
L. Cseppentő, Z. Micskei. "Evaluating code-based test input generator tools", Softw Test Verif Reliab. 2017. DOI: 10.1002/stvr.1627 Author's PDF
If you are interested in SETTE, please see the general overview of the Approach, then head to the Install Instructions page and please follow the tutorial (How to Use SETTE). All the experiment results can be found in the sette-results repository. If you prefer a quick start, you might want to check out our screencast about the framework. If you have any questions or remarks, please feel free to contact us.