Hi,

When I'm using the decoder I have to tokenize my target sentences before I
translate them. However, when I detokenize them it leaves awkward spaces
around what was tokenized. is there any way to fix this? It seems to be
mainly around slashes and colons

Source: :doc:`/tutorial/aggregation-zip-code-data-set`
Target: : Doc: '/ tutorial / aggregation-zip-code-data-set'

Thanks,
Judah
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to