-
Notifications
You must be signed in to change notification settings - Fork 5
Home
Welcome to the Symbolic Execution-based Test Tool Evaluator (SETTE) wiki!
With the SETTE framework (not only symbolic execution-based) test input generators can be evaluated and compared. Our objective was to give a fine-grained feedback on several test generators. We collected the important features of imperative languages, implemented a set of code snippets (see sette-snippets), the test generators generated test inputs for them, and based on the results and achieve coverage we evaluated the capabilities of the tools.
Currently, the following tools are supported by SETTE (completely automatic execution evaluation):
In addition, we have evaluated one tool manually:
- Pex (now called IntelliTest)
For an overview of the approach and the results see the following paper:
L. Cseppentő, Z. Micskei. "Evaluating Symbolic Execution-based Test Tools", In Proc. of IEEE Int. Conf. on Software Testing, Verification and Validation (ICST), Graz, Austria, 13-17 April 2015. DOI: 10.1109/ICST.2015.7102587 Author's PDF
If you are interested in SETTE, please see the general overview of the Approach, then head to the Install Instructions page and please follow the tutorial (How to Use SETTE). All the experiment results can be found in the sette-results repository. If you prefer a quick start, you might want to check out our screencast about the framework. If you have any questions or remarks, please feel free to contact us.