On 09/02/12 09:21, Joern Kottmann wrote:
So you always need a space between two tokens.
I can very easily interpose a space between each token before the name-finder receives it....
Is that what you mean or that i should train my own tokenizer? Jim
On 09/02/12 09:21, Joern Kottmann wrote:
So you always need a space between two tokens.
I can very easily interpose a space between each token before the name-finder receives it....
Is that what you mean or that i should train my own tokenizer? Jim