Lots of factors. Price, Availability of that value, etc.. can factor into the choice between ceramic, electrolytic, and tantalum. 

Also, all 3 types of capacitors have their own parasitic effects as well. For example, the Ceramic capacitors will vary their capacitance based on the voltage applied across the dielectric. This effect may be undesirable for that part of the circuit. I do know this wrecks havok in vertical deflection circuits, it distorts the waveform.