I've smoked moldy bud plenty of times, I know many who have. I know not one person who has had adverse health effects as a result, but it can and does kill people who have compromised immune systems and other co-morbidity issues, therefore, it is not recommended to do so.
Almost any treatment, even a quick boiling of the bud, would kill the mold and render it totally harmless.
Edit. If mold spores were as deadly as some make out we'd be dropping dead like flies. Almost every breath you take will have at least one mold spore present, often 100's.