Failed tests are silenced when -q is used

[bogdan]

What's the uncaptured output?

Summary

The -q option hides failed tests from output

PoC

$ make test-without-building
xcodebuild test \
		-project TrueArt.xcodeproj \
		-scheme TrueArt \
		-destination 'id=06F2A4D5-640C-4774-80FF-2CBB073856A4' \
		-parallel-testing-enabled NO \
		DEVELOPMENT_TEAM=SSY9UMBZ4Q | xcbeautify --disable-logging
Resolving Package Graph
Resolved source packages
--- xcodebuild: WARNING: Using the first of multiple matching destinations:
{ platform:iOS Simulator, id:06F2A4D5-640C-4774-80FF-2CBB073856A4, OS:18.1, name:iPhone 16 Pro }
{ platform:iOS Simulator, id:06F2A4D5-640C-4774-80FF-2CBB073856A4, OS:18.1, name:iPhone 16 Pro }
[GRDB_GRDB] Processing empty-GRDB_GRDB.plist
[TrueArt] Processing empty-TrueArt.plist
[TrueArtTests] Processing empty-TrueArtTests.plist
Signing TrueArtTests.xctest (in target 'TrueArtTests' from project 'TrueArt')
Signing TrueArt.debug.dylib (in target 'TrueArt' from project 'TrueArt')
Signing __preview.dylib (in target 'TrueArt' from project 'TrueArt')
Signing TrueArt.app (in target 'TrueArt' from project 'TrueArt')
All tests
Test Suite 'All tests' passed at 2024-12-09 11:40:48.581.
Executed 0 tests, with 0 failures (0 unexpected) in 0.000 (0.000) seconds
Test run started.
Suite MediaTests started
    ✔ persistence() (0.002 seconds)
    ⚠️  Test qq() recorded an issue at MediaTests.swift:15:9: Expectation failed: true == false
    ✖ qq() (0.001 seconds) 1 issue(s)
Suite MediaTests failed after 0.004 seconds with 1 issue(s)
Suite TrueArtTests started
    ✔ example() (0.001 seconds)
Suite TrueArtTests passed after 0.001 seconds
Test run with 3 tests failed after 0.004 seconds with 1 issue(s)
2024-12-09 11:40:56.675 xcodebuild[46213:35185203] [MT] IDETestOperationsObserverDebug: 16.317 elapsed -- Testing started completed.
2024-12-09 11:40:56.675 xcodebuild[46213:35185203] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start
2024-12-09 11:40:56.675 xcodebuild[46213:35185203] [MT] IDETestOperationsObserverDebug: 16.317 sec, +16.317 sec -- end
Failing tests:
	MediaTests.qq()

** TEST FAILED **

Testing started

$ make test-without-building
xcodebuild test \
		-project TrueArt.xcodeproj \
		-scheme TrueArt \
		-destination 'id=06F2A4D5-640C-4774-80FF-2CBB073856A4' \
		-parallel-testing-enabled NO \
		DEVELOPMENT_TEAM=SSY9UMBZ4Q | xcbeautify --disable-logging -q
--- xcodebuild: WARNING: Using the first of multiple matching destinations:
{ platform:iOS Simulator, id:06F2A4D5-640C-4774-80FF-2CBB073856A4, OS:18.1, name:iPhone 16 Pro }
{ platform:iOS Simulator, id:06F2A4D5-640C-4774-80FF-2CBB073856A4, OS:18.1, name:iPhone 16 Pro }
Test Suite 'All tests' passed at 2024-12-09 11:41:16.832.
Executed 0 tests, with 0 failures (0 unexpected) in 0.000 (0.000) seconds
Test run started.
Suite MediaTests failed after 0.005 seconds with 1 issue(s)
Suite TrueArtTests started
Suite TrueArtTests passed after 0.001 seconds
Test run with 3 tests failed after 0.006 seconds with 1 issue(s)
2024-12-09 11:41:24.890 xcodebuild[46506:35194926] [MT] IDETestOperationsObserverDebug: 16.319 elapsed -- Testing started completed.
2024-12-09 11:41:24.891 xcodebuild[46506:35194926] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start
2024-12-09 11:41:24.891 xcodebuild[46506:35194926] [MT] IDETestOperationsObserverDebug: 16.319 sec, +16.319 sec -- end
Failing tests:
	MediaTests.qq()

** TEST FAILED **

Suggested Regex

No response

Suggested Output

No response

Additional Context

No response