Once that pollen hits that bud...the magic of creation begins. Sorry once bud gets pollinated its only a matter of time till it's covered in seeds. If the male flowers haven't popped open you can just pick them off and go on as business as usual. Just check every couple of days for more flowers and pick them off too. Some plants hermi their last 2-4 weeks. It could have been one the whole time and you didn't know about it.