How much damage depends on the weather mostly, and hot sunny conditions favour butterflies.
Yes its difficult to keep large plants covered and Brussels often survive summer then make their harvest when caterpillars are not there.
Its up to you. Squash any you see, or spray Dipel.
