Le 26/02/2013 22:23, Georg Baum a écrit :
Jean-Marc,
many thanks for your noweb improvements! While investigating how your test
document could be added to the test suite I stumbled over some encoding
warnings that are currently output for CJK.tex. I added this warning (in
iparserdocstream::setEncoding()), but when looking at the actually parsed
stuff it looks like the warning is wrong. I see that you use from_utf8() in
Parser::deparse(), and if that is correct the warning is indeed nonsense,
but I do not understand: Why is this correct? Do you know whether it is
always correct?
The stream gives us docstring:s, but Toekn stores this as UTF8 string:s.
Look at the Token constructor in Parser.h.
This is just an artefact of the lack of docstring support in the parser.
We could translate most of it internally, though.
JMarc