I don't think there's any difference between a dead battery and no battery in an iMac, it should still boot.

It's the same 3.6 v battery that they've been using forever, so luckily they're not hard to find. Also not hard to replace.