Sure, all you need is a system floppy disk.

The floppy disk question mark is simply a prompt for a new operating system. OSes do need reinstalling after a while.

One of my SE's does the same thing, except that it actually rejects my system disk. Let's hope that this isn't the case with your Color Classic!

Hope that helps,

-Apostrophe