Try disconnecting the power and removing the battery (test the battery too). I've had problems with my old Mini starting up, and following those steps seemed to solve the problem. (1st generation Intel Mac Mini in my case.)