I have to remove the build directory often enough - builds should cache downloaded artifacts somewhere outside of it.

I'm looking at you, kvm and coreos flavors.