You have no danger of it now, so dont sweat it for another few days. You'll see huge bananna sacs with about a dozen nuts on it before they risk pollenating your crop. If it is a male, just chop it at the stem and gently remove it from the population.