Hello I have concern the tonkenizer script, When i so the tokenization, i got some """ and "'".. wHen i let them in the training process i think it damage the translation quality? So should i really let them or transform them to " and ' after training.
Thank you in advance for your reply Best Cyrine
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
