No, ADB's not hot swappable per the spec. It's a maybe you can do it without damage, but really should not. That said, mechanical the KVM switches do it, but the rotary switch likely reduces the chance of damage significantly over hot plugging ADB manually.

BTW: Peripherals would be the forum of choice.