I've tried to boot with the hard drive disconnected and I got the floppy icon with the flashing question mark. That's pretty much as expected.

I tried pulling the 32MB SIMM that's in it and booting with just the 4MB onboard and the problem remained the same, just a little faster.