Re: [pylucene-dev] Editing Java analyzers in PyLucene

2008-10-16 Thread Andi Vajda
On Thu, 16 Oct 2008, Martin Bachwerk wrote: > This should be straightforward, I just don't know the best way :) > > I want to edit the StandardTokenizer a bit so that it tokenizes a bit > differently compared to now. I found the StandardTokenizerImpl.jflex > file in which the rules appear to be s

[pylucene-dev] Editing Java analyzers in PyLucene

2008-10-16 Thread Martin Bachwerk
Hi, This should be straightforward, I just don't know the best way :) I want to edit the StandardTokenizer a bit so that it tokenizes a bit differently compared to now. I found the StandardTokenizerImpl.jflex file in which the rules appear to be set and all I need is a small modification in th