Revert "Ensure token is refreshed on Unauthenticated (#5388)" (#5404) #3546

Job	Run time
test-bootstrap	30s
build-and-push-single-binary-image	5m 22s
build-and-push-sandbox-bundled-image	2m 58s
sandbox-bundled-functional-tests	8m 15s
	17m 5s

Provide feedback