If you get a chime, then you just need a battery. If you don't, then you do need to solder that capacitor back.

Soldering isn't hard to learn at all, and since it's just two leads, it'd be hard to screw up. It's worth the investment to buy a soldering iron, some solder, some desoldering braid, a 99¢ practice circuit board, and a $1.29 14 pin socket to practice. Then you won't be afraid to do the next soldering job.