The Classic II is not affected by a dead battery. I've used a Classic II with a bad battery extensively in the past (to the point where I stuck the "Date & Time" control panel in the "Startup Items" folder until I could get a replacement) and never had any problems with bootup. (The LC475/Quadra 605, both with rocker switches for power, are notorious for not starting up if the battery is dead).

I agree with those who have listed caps as a problem.