use the tokenizer.perl script with the arg
-l de
On 28/03/2016 15:23, Alapan Kuila wrote:
Sir,
Please provide some script or program for German tokenizer.
Is it right to use tokenizer.perl (
~/moses/scripts/tokenizer/tokenizer.perl) for German
tokenization?Please help.
Thanks and regards,
Alapan
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
