chore: simplify StatsSet (#1672) #5686

Job	Run time
License Check and Audit Check	1m 37s
Check generated proto/fbs files are up to date	48s
bench test	9m 56s
Rust build (all-features)	6m 44s
miri	13m 43s
Rust build (default features)	4m 20s
Python (lint)	3m 30s
Rust build (with tokio dispatcher)	4m 17s
Rust build (with compio dispatcher)	4m 17s
Python (test)	4m 4s
Rust build (with tokio+compio dispatcher)	4m 17s
Rust (docs)	1m 20s
Rust build (wasm32 with default features)	2m 38s
Rust (tests)	7m 45s
	1h 9m 16s

Provide feedback