For future reference, if your discs just keep ejecting rather than starting up, try disconnecting the keyboard.

I was using a PC keyboard which kept ejecting the drive on boot for some reason. Connecting an Apple keyboard solved the problem.