Some cache helps a lot, but after a specific amount adding more does very little.

If you look at PCI powermacs the CPU upgrades with 1MB cache are much faster then the ones with 512K cache, no cache would be slow as dirt (like the original 233 Wallstreet CPUs with nocache).