I'd be the same way! I was at work today and the phone didn't ring for about ten minutes or so and I found myself going crazy because of that!
This is why I love the field of education (my study in school)--you've got to be alert every minute you're on the job and there is no such thing as a second without something going on. Even if the students are in the middle of SSR, you've got to be prepared for anything.