I don't see them as much in this area, I've never come across them in a field, always the ground hornets and they "bumble" around once disturbed, most times you will get away.
I've fooled with bees to learn something, odd as it sounds, good to know sometimes.
Brown paper wasp will come after you to a point and turn back, I've outrun them, after intentionally disturbing them, sometimes ending up in a light sting, but I realized they can be serious at times, or bumble around near the nest, just that you don't know which way it will go.
Yellow jacket, or yellow paper wasp, they are quite ornery, but most times fly erratically near the nest when disturbed, though I've been nailed out of nowhere, for no seemingly good reason, just walking by, always a rotten apple in the barrel ! I think the brown ones are much worse, as they will find you if they want, man to man defense vs these guys put on a zone defense, hoping one of the mass numbers of them will get you. Around here, if you try to kill a nest and don't get em all, they return for days and are very aggressive, sometimes start a new nest, but they don't forget. With all of them it seems if one does get you 1x, you are in for it, that initial sting is the thing to avoid no doubt.
Hornets, the black and white ones, are nothing to fool with, you hit that nest, your done. I've tossed things at the nest to wake em up, and they are unreal, though safe from a distance, you get nailed by one, there will be a party on you immediately, and they leave a sentry out at night, nothing to fool with, came face to face with a nest while clearing brush, that particular bush remained, was a close call, good thing that nest stands out, was bigger than a basketball. We used to knock em down with a basketball in the park on those old trees and be running before it hit the ground. If you stand near the nest, they seem to have a flight way in line with the hole, if you get in their way, they will just politely go around you, but just touch that nest, that is it.
I've got a nest of bumble bees under the central A/C compressor, condenser on a plastic pad outside, but they are right next to the garden, bumped the unit one afternoon, saw em come out, least I know they are there now, they did not find me, but I know they can be as bad as hornets, put one of those and wasp in a jar, bumble bee will win.