Fix resource leak in gateway when using Pulsar #2663

Job	Run time
Unit tests (Runtime)	6m 59s
CLI End to End tests	11m 1s
Unit tests (Runtime IT)	17m 42s
End to End tests (Python, python)	19m 2s
Unit tests (Deployer)	7m 16s
End to End tests (Other, other)	18m 37s
Unit tests (Api Gateway)	7m 54s
Unit tests (Control plane)	4m 6s
Unit tests (Other)	11m 32s
Unit tests (Style)	3m 47s
	1h 47m 56s

Provide feedback