4MB would probably give some improvement but not likely enough to be worth it. There were a couple 2MB cache DIMMs made way back but it never went from there because the performance gain wasn't big and they cost way too much.

One of the problems was the cache didn't run anywhere close to CPU speed like the onboard ones today. It was better than having just the aging DRAM memory bus of the day, but still limited.