Can the expansion cards access all of the normal system memory? If so, you could certainly access the video ram directly. Otherwise, why not just use an sram chip with another avr microcontroller to copy video memory into and just have the ATmega 328 read the sram for video data?