This seems like a 32-bit limitation. The maximum addressable memory with 32 bits is 4 GB, and it seems that you could not have a full 4 GB of RAM because some address space must be reserved for other things, such as ROM and peripherals.

For 4+ GB of RAM, you generally have to look at computers that have 64-bit processors. This started with the G5 on Macs.