Well, the SE is technically capable of running System 1.0, and I guarantee you won't find a single hardware driver compatible with that, so that requirement makes your goal impossible.

System 4.0, Finder 5.4 were the current System/Finder at the time of the SE's release, and are the lowest "official" versions for it.

Unfortunately, other than a video card to run Radius' custom-interface portrait monitor, all the other SE PDS cards I can find info on require at least System 7. (And I can't even find reliable info on what the minimum system for the Radius card is.)