Hi,

yes, this is normal.

The script tokenizer.perl creates these tokens, you have to run
detokenizer.perl on the output to revert to normal text.

-phi

On Tue, Nov 24, 2015 at 4:18 PM, 徐同学 <[email protected]> wrote:

> Hi,
>
> There are “ &apos;” in the translated text. I noticed that escaping is
> necessary for the tokenized file during corpus preparation.
> But when the translation is done, how can I change all the “ &apos;” back
> to the normal apostrophe?
> Here attaches my translated file.
>
> _______________________________________________
> Moses-support mailing list
> [email protected]
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to