Hi, I see. Thanks.
Jehan On Sat, Dec 10, 2011 at 12:25 PM, Hieu Hoang <[email protected]> wrote: > hi jehan > > it add a new line because > 1. some scripts/executables won't read the last line > 2. make file concatenation files (using 'cat') consistent. Without > the newline the last line of the 1st file is on the same line as the > first line of the 2nd file. > > i think this practise is pretty much standard when processing text with > unix-OSes. > > it has nothing to do with pretty print. > > On 09/12/2011 10:47, Jehan Pages wrote: >> Hi, >> >> if a provided source text has no finale line feed ("\n"), the >> (de)tokenizer script would add it. >> That's line 166 of detokenizer.perl and 141 of tokenizer.perl: >> $text .= "\n" unless $text =~ /\n$/; >> >> So I imagine this was meant for pretty printing on a bash console (you >> don't want the prompt to start after the return), but that adds data >> to the original data, which makes these scripts no reliable. But >> pretty-printing is convenient for locale tests, but not for actual >> usage. >> That's not much of a serious bug, and it can be easily bypassed, so I >> haven't directly propose a patch because I wondered if people out >> there really want it like this. Do we? (I personally find these kind >> of things annoying, even though only a detail) >> Thanks! >> >> Jehan >> _______________________________________________ >> Moses-support mailing list >> [email protected] >> http://mailman.mit.edu/mailman/listinfo/moses-support >> > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support _______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
