Just to clarify, the SE/30 takes sets of four SIMMs, not two, so you'd need a minimum of 64 megs if you use 16 meg SIMMs or 16 megs if you use 4 meg SIMMs.
I can understand not wanting to buy 16 meg SIMMs, but 4 meg SIMMs are certainly not hard to find. Sometimes it's better to have a little more than you think you might ever use.