BeOS? I've no idea, unfortunately. As for writing your own drivers, AFAIK Apple never released in-depth technical documentation for that subsystem to anybody but developers, if even them.

My suggestion would be to grab one of the PPC Linux distros that support video out (if any do, maybe mkLinux) and reverse-engineer them, as they were probably reverse-engineered from Mac OS drivers themselves.