I guess each beekeeper has their own standards, but 2m is definitely not too close as far as I'm concerned! I stand within 2m or less of my hives on an almost daily basis, just watching what they're up to, without any gear on, or any problems. I also regularly lift the roofs to peek through the crown board or insert/remove inspection trays without needing any protective gear. If this started to become an issue on a regular basis, I'd be looking at replacing a queen - but then my hives are currently in a garden, so this is particularly important to me. If your hives were in an out apiary obviously you could tolerate more defensiveness.
Two of my hives are less than 2m to the side of the footpath up our garden to the chickens, and their flight path crosses the path. We go up to let the chickens in/out, collect eggs etc. several times a day. Like StephenT, you get the odd bee that doesn't see you coming, bouncing off your head, but if you walk through slowly (and ideally without messy or curly hair!), they just carry on their way.
Every hive can have its bad day. I can only imagine how much the defensiveness of a colony under attack from hornets might increase. Obviously that's not currently an issue I have here, but there are lots of other factors that can upset a hive: thundery weather; the end of a flow; nuisance wasps; high varroa count; queenlessness etc.
At this point I'd be giving your bees the benefit of the doubt, given a lack of stores and attack by hornets, but if this became 'normal' prolonged behaviour I'd want to do something about it. Whatever you can do to help them battle the hornets will I'm sure be appreciated by the bees.