Labels don't work correctly when the vk sampler cache is enabled.

The samplers will get their labels constantly overwritten. This will be confusing for the user. Not sure what we should do about it though.