RE: Date faceting and memory leaks

2010-05-17 Thread Yao
From: Chris Hostetter-3 [via Lucene] [mailto:ml-node+825052-1711725506-201...@n3.nabble.com] Sent: Monday, May 17, 2010 9:04 PM To: Ge, Yao (Y.) Subject: Re: Date faceting and memory leaks : Cache settings: : that's a monster filterCache ...i can easly imagine it causing an OOM if

Re: Date faceting and memory leaks

2010-05-17 Thread Yao
Chris, Just completed the re-run and your date rounding tip saved my day. I now realized the "NOW" as a timestamp is a very bad idea for query caching as it is never the same in value. NOW/DAY would at least makes a set facet queries caches re-usable for a period of time. It turns on you can help

Re: Date faceting and memory leaks

2010-05-17 Thread Chris Hostetter
: Cache settings: : that's a monster filterCache ...i can easly imagine it causing an OOM if your heap is only 5G. : The date rounding suggest is a very good one, I will need to rerun the test : and report back on the cache setting. I remember my filterCache hit ratio is : around 0.7. I did u

Re: Date faceting and memory leaks

2010-05-17 Thread Yao
Chris, Thanks for the detailed response. No I am not using Date Facet but Facet Query as for facet display. Here is the full configuration of my "dismax" query handler: dismax explicit 0.01 title text^0.5 domain^0.1 nature^0.1 author title

Re: Date faceting and memory leaks

2010-05-17 Thread Chris Hostetter
: Subject: Date faceting and memory leaks First off, just to be clear, you don't seem to be useing the "date faceting" feature, you are using the "Facet Query" feature, your queries just so happen to be on a date field. Second: to help people help you, you need to provide all the details. you

Re: Date faceting and memory leaks

2010-05-17 Thread Yao
No I still have the OOM issue with repeated facet query request on the date field. I forgot to mention that I am running 64-bit IBM 1.5 JVM. I also tried the Sun 1.6 JVM with and without your GC arguments. The GC pattern is different but the heap size does not drop as the test going on. I tested w

Re: Date faceting and memory leaks

2010-05-17 Thread Antonio Lobato
2010 2:44 PM > To: solr-user@lucene.apache.org > Subject: Re: Date faceting and memory leaks > > What garbage collection settings are you running at the command line > when starting Solr? > On May 17, 2010, at 2:41 PM, Yao wrote: > >> >> I have been running load testing using JM

RE: Date faceting and memory leaks

2010-05-17 Thread Ge, Yao (Y.)
44 PM To: solr-user@lucene.apache.org Subject: Re: Date faceting and memory leaks What garbage collection settings are you running at the command line when starting Solr? On May 17, 2010, at 2:41 PM, Yao wrote: > > I have been running load testing using JMeter on a Solr 1.4 index with ~4 >

Re: Date faceting and memory leaks

2010-05-17 Thread Antonio Lobato
What garbage collection settings are you running at the command line when starting Solr? On May 17, 2010, at 2:41 PM, Yao wrote: > > I have been running load testing using JMeter on a Solr 1.4 index with ~4 > million docs. I notice a steady JVM heap size increase as I iterator 100 > query terms