+1 Informative.
Yup, it's not how still you're holding the camera, it's the fact that you're too close for your camera to focus.
Look for a button (or menu setting) of a flower, that is the universal icon for "Macro mode", which allows it to focus on closer objects. Note that even in Macro mode, you may not be able to get close enough, it depends on the camera. Make sure your zoom is all the way OUT, not in, if you are physically close. If you prefer, you can try stepping further away and zooming in, but on some cameras, the minimum distance is better enough zoomed out that you can fill more of the frame with the object zoomed out in macro mode than zoomed in without macro mode.