fix: refactor adapter weight loading and mapping #549

Job	Run time
build (cuda) / build-and-push	1s
build (cuda) / build-and-push	19m 5s
build (cuda) / build-and-push	7m 25s
build (intel) / build-and-push	1s
build (intel) / build-and-push	19m 6s
build (intel) / build-and-push	59m 57s
build (rocm) / build-and-push	1s
build (rocm) / build-and-push	19m 4s
build (rocm) / build-and-push	7m 36s
build (intel) / integration_tests	1s
build (intel) / integration_tests	0s
build (intel) / integration_tests	0s
build (rocm) / integration_tests	1s
build (rocm) / integration_tests	0s
build (rocm) / integration_tests	0s
build (cuda) / integration_tests	1s
build (cuda) / integration_tests	0s
build (cuda) / integration_tests	10m 50s
	2h 23m 9s

Provide feedback