I can count the number of ROM03 incompatible programs which I've experienced on one hand. They are mostly the FTA-type demos.

The speed increase is due to more of the GS/OS toolbox being in ROM rather than having to be loaded from disk.