Well, thinking positevely it could just be the speaker that's about to die. That wouldn't be so bad. You mention that if you move it the sound gets worse. I don't know that much as some ppl here but can that little speaker experience interference from something with a magnet, or a crt monitor?

Some speaker noises are asociated with bad capacitors on the analog board, although i wouldn't know which ones.