Caching is not utilized for development

[Mossaka]

For some reason, in a cleaned repo, the cross test command does not pick up the cache from cross build command, so sudo make test which runs cross build first and then cross test takes a long time to finish.

[Mossaka]

This can also be seen from the CI run.

Ideally, once built, make test should be very fast.