Certainly remove the bad, and check out "Trifecta Crop Control". The shit is pricey, organic and claims to be safe to harvest (read up and make your choice). I have used it, it works, it left no after/off taste. Like everyone else I dont like to spray my buds, but it's there if you wish to give it a look, did I say its pricey? Of course you would still need fan/s and keep them dry as possible.
Also be sure its rot, do the buds have smushy shit in them? Smell like mold? Are they just laying loose? Bud worms and other bugs will cut the bud off at the steam, the bud dies turns brown you see it and freak out (I do LOL).
There are plants that like Pieburt that are somewhat immune, but they make lite airy fluffy buds.