Provided that you haven't left files any open or any programs running (i.e. you're in the Finder) then there's no problem with doing that. And remember to eject the floppy before turning it off because it won't eject automatically.