Oh, they're definitely 4mb SIMMs. I did a little searching and found that I was installing the SIMMs into the memory expansion card, and not the slots on the motherboard.

So my next question is, why does my Classic II have a memory expansion card? It's clearly identified as a Classic II on the case. Did I get a Mac Classic in a Classic II case? How would I check?