> Can you file a bug report to the xterm people? I don't think it's a bug in xterm. Nroff emits <ESC>[40m codes, which normally means "set background color to black", and this is exactly what xterm is doing.
Pipe the output through "sed -e 's/40m/41m/g'" before viewing (this changes the background from black to red) to illustrate this.
