These can be a lot more difficult to control than actual pollen sacs, since they start pollinating everything in the area as soon as they appear. A few bananas won’t do much damage, but if you have a big banana problem it may be best to harvest the plants immediately and cut your losses. It can pollinate other plants too. You can try picking them off and continuing...but you probably will have seedy buds.