fix: handle debug leafs with dispatch #3805

Job	Run time
test (1.10, ubuntu-latest, core_layers)	27m 19s
downgrade	1h 41m 13s
test (1.10, ubuntu-latest, normalize_layers)	24m 43s
test (1.10, ubuntu-latest, recurrent_layers)	32m 44s
test (1.10, ubuntu-latest, autodiff)	1h 5m 6s
test (1.10, ubuntu-latest, misc)	39m 48s
test (1.10, ubuntu-latest, reactant)	20m 44s
test (1, ubuntu-latest, core_layers)	35m 42s
test (1, ubuntu-latest, normalize_layers)	30m 49s
test (1, ubuntu-latest, recurrent_layers)	28m 46s
test (1, ubuntu-latest, autodiff)	35m 43s
test (1, ubuntu-latest, misc)	32m 42s
test (1, ubuntu-latest, reactant)	29m 17s
test (1, macos-latest, all)	1h 43m 1s
test (1, windows-latest, all)	1h 36m 28s
	11h 44m 5s

Provide feedback