Karol
I assume you are aware of the weta that can repeatedly be frozen? According to Wikipedia (may or may not be correct) it has particular proteins in its haemolymph to prevent it freezing. It may be a reasonable assumption to make that a queen wasp is similar. As another points out it’s necessary for a queen to survive the winter (as is also true of a weta) so it’s worth her while making the proteins, indeed there is an evolutionary pressure making such a necessity. There is no such evolutionary advantage to a worker as it would be dead before season’s end in any event. The extra effort in making the “antifreeze” would be a selection pressure not to bother, in other words worker wasps not making the proteins have more resources for other wasp activities and would do better. As wasps have castes the biochemistry could well be different. My hypothesis based on little more than supposition would therefore be that worker wasps can be easily killed by freezing, queens cannot.
It would be interesting to see how low a temperature a queen bumble could cope with too.