In my case, it's due to the fact that I'm so awesome that companies invite me in for an interview and say: "There's no way we can hire this guy because all the women here will stop working to sleep with him in the break room and our company will fail due to his charming good looks, huge balls, and foo-man-chu."

It may be different in your case, but that's how it usually goes for me.