Re: common words not stop words?? how to ??

2007-02-19 Thread rubdabadub
Walter: Thanks for the feedback. On 2/19/07, Walter Underwood <[EMAIL PROTECTED]> wrote: Lucene/Solr does this automatically. That is how a tf.idf engine works, it boosts rare words. Do you have examples of problems or are you worrying about something that might happen? Actually my use case

Re: common words not stop words?? how to ??

2007-02-19 Thread Walter Underwood
Lucene/Solr does this automatically. That is how a tf.idf engine works, it boosts rare words. Do you have examples of problems or are you worrying about something that might happen? wunder On 2/19/07 1:22 AM, "rubdabadub" <[EMAIL PROTECTED]> wrote: > Hi: > > I was wondering how are you guys de

common words not stop words?? how to ??

2007-02-19 Thread rubdabadub
Hi: I was wondering how are you guys dealing with "common words"? What I mean by common words is the ones that fall outside the "stop words" category. Offcourse "stop words" is subjective i.e. its up to the implementor. What I would like to do is how do i increase or decrease boost value based o