Leave alone, for all you know there already is another hatched out queen in there , they know what there doing ........we don't . And IMO don't put thymol on if they're relatively weak as when I used thymol several years ago the common result was any weak colony got hammered or killed off by wasps , I can only assume the smell from the thymol seemed to confuse the bees as to whatever flew in the front was friend or foe .
TBH I rather like wasps as if they're overrunning a hive then that hive isn't worth having .......natural selection and all that