You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The main question i would have about this fuzzer before making it general to be used with any runtime is:
what percentage of the blocks/extrinsics generated actually end up executing and doing something useful? If you have access to it, what is the histogram of Ok(_) vs Err(_)
Similarly, we need a metric of the size of the state. Is it growing? It should, and if not, I would argue that the above histogram would also be all Err(_) and the runtime is not doing anything.
For example, I would expect a good fuzzer, with the genesis state of a single account having the total issuance to end up spreading the total issuance over many accounts after many iterations. But, is that actually happening?
This is the type of question I am trying to answer here.
I am aware that this fuzzer has already been very useful catching bugs, so maybe my skepticism is not needed, idk. What type of bugs have been detected? is it mostly in the API/Encode/Decode level, or has it also detected a bug deep in the logic of a pallet?
The text was updated successfully, but these errors were encountered:
The main question i would have about this fuzzer before making it general to be used with any runtime is:
Ok(_)
vsErr(_)
Err(_)
and the runtime is not doing anything.For example, I would expect a good fuzzer, with the genesis state of a single account having the total issuance to end up spreading the total issuance over many accounts after many iterations. But, is that actually happening?
This is the type of question I am trying to answer here.
I am aware that this fuzzer has already been very useful catching bugs, so maybe my skepticism is not needed, idk. What type of bugs have been detected? is it mostly in the API/Encode/Decode level, or has it also detected a bug deep in the logic of a pallet?
The text was updated successfully, but these errors were encountered: