Re: Ngram tokenizer

2009-10-29 Thread Andi Vajda
On Oct 29, 2009, at 11:48, abhinav mishra wrote: It gives an error. And what is the error ? May be the problem is with the way I invoked the function. And what is the way ? I think a sample code to tokenize(ngram) would be sufficient. I'm trying to understand if your problem is a Luc

Re: Ngram tokenizer

2009-10-29 Thread abhinav mishra
It gives an error. May be the problem is with the way I invoked the function. I think a sample code to tokenize(ngram) would be sufficient. Abhinav On Thu, Oct 29, 2009 at 11:26 AM, Andi Vajda wrote: > > On Oct 29, 2009, at 10:28, abhinav mishra wrote: > > Hi, >> >> I know that there is a cl

Re: Ngram tokenizer

2009-10-29 Thread Andi Vajda
On Oct 29, 2009, at 10:28, abhinav mishra wrote: Hi, I know that there is a class EdgeNGramTokenizer, which can be used to extract n-grams. However, I'm not able use it. What do you mean by "not able to use it" ? Andi.. Any pointers or maybe, piece of code in this regard would be helpful

Ngram tokenizer

2009-10-29 Thread abhinav mishra
Hi, I know that there is a class EdgeNGramTokenizer, which can be used to extract n-grams. However, I'm not able use it. Any pointers or maybe, piece of code in this regard would be helpful. Regards, Abhinav