Improve build times

[adelhult]

Describe the bug
We should find a more long term solution to our very long build times. It might be helpful to restructure the packages directory to a dummy crate and really take extra care to ensure that we don't build the std-library when we don't need to.

We might also consider not bundling the std packages inside of the core tool and instead fetch it from the internet like any other dependency.