Cuprinol solvent based not aqueous should do the trick.
Failing that, teak oil adulterated with Oil of Olbas. 95 parts to 5 parts. Wasps are repelled by Eucalyptus oil. We formulated a deterrent for wasps but the cost of biocide registration was extortionately expensive so didn't take the product to market. The oil will sink into the wood provided it's soft and not tight grained hardwood and the aroma will fade quite quickly as the oil seeps into the wood only to be released again when the wood is chewed which then repels the wasps doing the chewing.
Just need to take care when applying. Choose a good test spot and trial a patch first to make sure you're happy with colour changes and that you can apply it safely. Light breezy conditions are best. Stifling hot days will see one coughing with streaming eyes if the smell is too strong.