Unless you are actively booting them, as far as I can tell there is no real reason (other than accumulated laziness in my own specific case) for leaving them in. Exploded battery juice cannot hurt a motherboard when it is no longer there.

The horror stories from others here are what finally got me off of my backside and just in time perhaps too.

Brian