Re: [sqlite] Extending Porter Tokenizer

2016-07-10 Thread Dan Kennedy
On 07/10/2016 01:33 PM, Abhinav Upadhyay wrote: On Fri, Jul 8, 2016 at 3:01 AM, Matthias-Christian Ott wrote: On 2016-07-05 18:11, Abhinav Upadhyay wrote: I'm wondering if it is possible to extend the functionality of the porter tokenizer. I would like to use the functionality

Re: [sqlite] Extending Porter Tokenizer

2016-07-10 Thread Abhinav Upadhyay
On Fri, Jul 8, 2016 at 3:01 AM, Matthias-Christian Ott wrote: > On 2016-07-05 18:11, Abhinav Upadhyay wrote: >> I'm wondering if it is possible to extend the functionality of the >> porter tokenizer. I would like to use the functionality of the Porter >> tokenizer but before

Re: [sqlite] Extending Porter Tokenizer

2016-07-07 Thread Matthias-Christian Ott
On 2016-07-05 18:11, Abhinav Upadhyay wrote: > I'm wondering if it is possible to extend the functionality of the > porter tokenizer. I would like to use the functionality of the Porter > tokenizer but before stemming the token, I want to decide whether the > token should be stemmed or not. > >

[sqlite] Extending Porter Tokenizer

2016-07-05 Thread Abhinav Upadhyay
Hi, I'm wondering if it is possible to extend the functionality of the porter tokenizer. I would like to use the functionality of the Porter tokenizer but before stemming the token, I want to decide whether the token should be stemmed or not. Do I need to copy the Porter tokenizer and modify it