Is the CPi the one that's a one-spindle design that relied on the dock station, or am I thinking of the CS?

Anyway, does it actually ahve a bios password? If not-- you should be able to install linux with no problem. Although the method you use may need to be creative, as I don't think the CPi will boot from USB. (The CS won't.) -- It may boot from compact flash in a PCMCIA > CF adapter though.