How big is a wasp nest when they first start building?

I have had wasps around my house for many years and I think I might have spotted where they stared building one. It is about the size of a quarter and a wasp was hanging off of it. I want to make sure that it is a wasp nest before I destroy it. It is a small circle and hanging off the house on the outside.