The FDD is polled first for a valid System Folder by the system during startup from cold. If the drive's mechanism is working properly, holding down the mousebutton during startup should eject an already-present diskette. If this technique is not successful, and if you cannot use the mechanical eject while the Mac is switched off, you will have to remove the drive for inspection.

Floppy drives were very effective in their day, but that day is now many years behind us. They can be forgiven, if their lubricating grease has hardened, or if someone has attempted a mechanical eject while the Mac was active, any of the aches and pains of age that they show.

de