Re: when to use Fieldnorm ??

2013-10-15 Thread Karan jindal
thanks shawn for quick insight about it. I will look more into this.. and will share my experience Thanks, Karan Jindal On Tue, Oct 15, 2013 at 12:10 AM, Shawn Heisey s...@elyograg.org wrote: On 10/14/2013 3:05 AM, Karan jindal wrote: Is there standard way of checking to know whether

Re: when to use Fieldnorm ??

2013-10-15 Thread Upayavira
I would say, if index size is not an issue, there's merit in indexing a field twice, once with these turned off, once with them turned on. That gives yuo the chance to choose at query time without major re-engineering efforts for your indexer code. Upayavira On Tue, Oct 15, 2013, at 07:08 AM,

when to use Fieldnorm ??

2013-10-14 Thread Karan jindal
Hi all, I have a general query about fieldNorm Is it advisable to use fieldNorm (which kinds of gives importance to shorter length fields). Is there any set of standard factors on which the decision of turning fieldNorm on/off can be taken? *In my use case:-* I have a user generated data and

Re: when to use Fieldnorm ??

2013-10-14 Thread Upayavira
You search for the word jack. Which of these three field values best matches? 1) Jack is great. 2) Billy was a young man. Billy studied well and lived well. Jack didn't. Billy went travelling and had a great time. 3) Billy didn't actually like Jack. Jack could at times be difficult. Jack would

Re: when to use Fieldnorm ??

2013-10-14 Thread Karan jindal
Thanks Upayavira for a quick reply, True what you have said. But the example you have given is more of descriptive nature. Will the same argument apply if field length can't be more than some threshold (say 10) like in case of Title? title are generally short in length. Consider following

Re: when to use Fieldnorm ??

2013-10-14 Thread Karan jindal
Is there standard way of checking to know whether switching off fieldNorm helps or not? Regards, Karan Jindal On Mon, Oct 14, 2013 at 2:30 PM, Karan jindal karanjindal1...@gmail.comwrote: Thanks Upayavira for a quick reply, True what you have said. But the example you have given is more of

Re: when to use Fieldnorm ??

2013-10-14 Thread Shawn Heisey
On 10/14/2013 3:05 AM, Karan jindal wrote: Is there standard way of checking to know whether switching off fieldNorm helps or not? If you will *NEVER* care about how the length of a field affects your relevancy score, you can omit norms for that field. If you don't care at *all* about how