Hmm, looking at this further, when my mouse cursor freezes it looks like the VIA VBL interrupt handler itself stops getting called. So that suggests there's either something wrong with my VIA implementation, or some other interrupt is continuously firing and preventing the lower-priority VIA interrupt from ever getting handled, or something of that sort. Time to dig a little deeper...