AV actually recommends drinking moldy fruit juice for a detoxification. He says it can be intense though and last for months, I'm not sure I want to mess with that right now.
As for just a little mold I wouldn't worry about it, in fact I've never heard of a "mold sickness" amongst even cooked food eaters. There are mold infections people talk about but I've never heard that consuming mold causes them.