test: try fixing enzyme test #3829

Job	Run time
test (1.10, ubuntu-latest, core_layers)	30m 38s
test (1.10, ubuntu-latest, normalize_layers)	21m 41s
test (1.10, ubuntu-latest, recurrent_layers)	28m 25s
test (1.10, ubuntu-latest, autodiff)	57m 38s
downgrade	1h 33m 15s
test (1.10, ubuntu-latest, misc)	38m 37s
test (1.10, ubuntu-latest, reactant)	14m 12s
test (1, ubuntu-latest, core_layers)	1h 4m 7s
test (1, ubuntu-latest, normalize_layers)	35m 4s
test (1, ubuntu-latest, recurrent_layers)	39m 38s
test (1, ubuntu-latest, autodiff)	1h 24m 46s
test (1, ubuntu-latest, misc)	55m 37s
test (1, ubuntu-latest, reactant)	1h 21m 25s
test (1, macos-latest, all)	6h 0m 41s
test (1, windows-latest, all)	1h 42m 57s
	18h 28m 41s

Provide feedback