It sounded like the output file had to not specify the paper size.
It is true.
The texinfo manual told me how to generate A4 but not to do this.
>From the `Format with texi2dvi' node:
Perhaps the most useful option to `texi2dvi' is `--texinfo=CMD'.
This inserts CMD on a line by itself after the `@setfilename' in a
temporary copy of the input file before running TeX. With this, you
can specify different printing formats, such as `@smallbook' (*note
smallbook::), `@afourpaper' (*note A4 Paper::), or `@pageparams' (*note
pagesizes::), without actually changing the document source. (You can
also do this on a site-wide basis with `texinfo.cnf'; *note Preparing
for TeX: Preparing for TeX.).
