That sounds scary!

Ours are not exactly like yours, they are large and make open nests of about 20 individuals - they have a tendency to build under the roof of the house and close to doors. They become aggressive once the nest is large at the end of summer and we get rid of them by spraying the adults at night when they are sleeping and then removing and crushing the nest in the morning or the young wasps that are already pupating will hatch and continue there.