RE: Alternative way to simulate sorting without doing actual sort

2009-07-23 Thread Uwe Schindler
Ganesh [mailto:emailg...@yahoo.co.in] > Sent: Thursday, July 23, 2009 8:01 AM > To: java-user@lucene.apache.org > Subject: Re: Alternative way to simulate sorting without doing actual sort > > Hello Eric, > > I agree, the number of unique terms might be less, but [ 4 * > read

Re: Alternative way to simulate sorting without doing actual sort

2009-07-23 Thread Ian Lea
Message - > From: "Erick Erickson" > To: > Sent: Thursday, July 23, 2009 1:55 AM > Subject: Re: Alternative way to simulate sorting without doing actual sort > > >>I was assuming you were storing things as strings, in which case >> it works something l

Re: Alternative way to simulate sorting without doing actual sort

2009-07-22 Thread Ganesh
ubject: Re: Alternative way to simulate sorting without doing actual sort >I was assuming you were storing things as strings, in which case > it works something like this: > Let's say you broke it up into > > MM > DD > HH > MM > > The number of unique terms tha

Re: Alternative way to simulate sorting without doing actual sort

2009-07-22 Thread Erick Erickson
esh > > > - Original Message - > From: "Erick Erickson" > To: > Sent: Tuesday, July 21, 2009 7:29 PM > Subject: Re: Alternative way to simulate sorting without doing actual sort > > > > Have you tried splitting your times into separate fields, perhap

Re: Alternative way to simulate sorting without doing actual sort

2009-07-22 Thread Phil Whelan
Hi Ganesh, I'm not sure whether this will work for you, but one way I got around this was with multiple searches. I only needed the first 50 results, but wanted to sort by date,hour,min,sec. This could result in 5 results or millions of results. I added the date to the query, so I'd search for r

Re: Alternative way to simulate sorting without doing actual sort

2009-07-22 Thread Ian Lea
> Ganesh > > > - Original Message - > From: "Erick Erickson" > To: > Sent: Tuesday, July 21, 2009 7:29 PM > Subject: Re: Alternative way to simulate sorting without doing actual sort > > >> Have you tried splitting your times into separate f

Re: Alternative way to simulate sorting without doing actual sort

2009-07-22 Thread Ganesh
. Please correct me if i am wrong. I require some justification to split the date in to multiple terms. Regards Ganesh - Original Message - From: "Erick Erickson" To: Sent: Tuesday, July 21, 2009 7:29 PM Subject: Re: Alternative way to simulate sorting without doing a

Re: Alternative way to simulate sorting without doing actual sort

2009-07-21 Thread Erick Erickson
Have you tried splitting your times into separate fields, perhaps one with MMDD and another with HHMM, then do a primary sort on the YYYMMDD and secondary on HHMM. That'll reduce your total unique values greatly and should improve your memory consumption. Best Erick On Tue, Jul 21, 2009 at 4:2

Alternative way to simulate sorting without doing actual sort

2009-07-21 Thread Ganesh
Hello all I am sorting on datetime with minute resolution. It easily reaches the maximum heap size. I am having almost 100M records and it is using 1.5 GB. I am now in a situitation to stop sorting and to find some other alternative way. I tried adding document boost and field boost for date t