Yes, that's normal behavior for a dead battery, mine does the same thing. The outside cover will slide off the battery with a little effort, and then you can at least put the cap back on so there's not a visible hole on the case.

It's a nice machine, enjoy.