They may well be to beekeepers but on balance they are still a beneficial insect.
It would be no surprise if there is an inverse corrolation between hive diseases and wasp populations. High wasp populations improve bee fitness at a population level.
At this time of year, these are most likely still queen wasps especially given how cold it has been. It might sound like an opportunity to get rid of a problem by killing them now, but doing so creates other problems elsewhere. Wasps eradicate vast quantities of other insect pests. Allotments will suffer higher pest infestations resulting in higher pesticide use. There is an inverse corrolation between wasp populations and the incidence of Lyme's disease. Wasps weed out infected hives and reduce spread of bee diseases by removing honey thus reducing robbing by healthy bees.