If you want a starting point that isn't enormous, /n/sources/contrib/rsc/8i has an x86 emulator that I've used to dump the vesa modes on video cards before. It didn't work with mode switching though, probably because it needed to do something priviledged. (It was definitely trying to turn off interrupts!)
Russ
