v0.04: config,make: remove un-needed library dependencies

Also, improve the usage of existing pkg-config support
for libraries (apteryx, glib)

Reviewed-by: Carl Smith <[email protected]>
Signed-off-by: Scott Parlane <[email protected]>