I did this with 3 AA batteries. It works fine. I got some used Rayovac 4.5v batteries off of eBay also. They were cheaper than new ones and seem to hold a good charge.
I also found a comparable battery in Fry's for like $8, but it was the last one, and it seemed like they did not sell such batteries anymore.