Have you tested the RAM in the machine? The other suggestions are good ones, but a flawed RAM module is also consistent with the problems that you are having and would explain why changing VM settings affects the symptoms.
Dennis, don't you belong over on the Larry Niven group? What are you doing over here?