Fix talk_start_5m error spam when physical rooms are in use

Fix talk_start_5m error spam when physical rooms are in use #236