You might wanna check. I assumed mine was the PSU as well, but it's definitely the speaker.

Once on, it goes quit every now and then only to start the whine again a few seconds later. Definitely not something that being powered on for a while cures.