Remove most `default-members` to speed up builds and reduce duplication #9298

Job	Run time
prepare-linux	5s
build-macos	3m 12s
build-windows (windows-latest, x64)	11m 7s
build-windows (self-hosted, ARM64, Windows, arm64)	7m 27s
build-linux (stable)	3m 42s
build-linux (beta)	4m 5s
build-linux (nightly)	3m 25s
	33m 3s

Provide feedback