I think we have to look at it this way. Has anyone blown an ADB device or ADB connection on a logic board by swapping with a system that is powered down?

If the answer is "no", and we have at least anecdotal evidence that it has happened when people tried to hot-swap, we have to accept that hot-swapping does indeed carry some risk above that seen with swapping cords while system is off.