Re: `cat /dev/null > solr-8983-console.log` frees host's memory

2015-10-21 Thread Eric Torti
Thank you Shawn, Timothy, Emir and Rajani. Sorry, Shawn, I ended up cropping out the legend but you were right on your guess. Indeed, Timothy, this log is completely redundant. Will get rid of it soon. I'll look into the resources you all pointed out. Thanks! Best, Eric Torti On Wed, Oct 21

`cat /dev/null > solr-8983-console.log` frees host's memory

2015-10-20 Thread Eric Torti
uld be greatly appreciated. Best, Eric Torti

Re: slow queries

2015-10-15 Thread Eric Torti
this relates to your problem because the GC pauses are not superior to 30s which seems to be the time zookeeper would let a node be irresponsive before considering it in recovery. Best, Eric Torti On Thu, Oct 15, 2015 at 6:51 AM, Lorenzo Fundaró <lorenzo.fund...@dawandamail.com> wrote: &

Re: Is solr.StandardDirectoryFactory an MMapDirectory?

2015-10-09 Thread Eric Torti
Ok, thanks Shawn! That makes sense. We'll be experimenting with it. Best, Eric On Wed, Oct 7, 2015 at 5:54 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 10/7/2015 12:00 PM, Eric Torti wrote: >> Can we read "high reopen rate" as "frequent soft commits"

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

2015-10-07 Thread Eric Torti
Hello Shawn, I'm sorry to diverge this thread a little bit. But could please point me to resources that explain deeply how this process of OS using the non-java memory to cache index data? > Whatever RAM is left over after you give 12GB to Java for Solr will be > used automatically by the

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

2015-10-07 Thread Eric Torti
Cool, Toke and Shawn! That's exactly what I was looking for. I'll have a look at those resources and if something is yet unclear I'll open a thread for it. Thanks for the information, Eric On Wed, Oct 7, 2015 at 10:29 AM, Shawn Heisey <apa...@elyograg.org> wrote: > On 10/7/2015 4:03

Is solr.StandardDirectoryFactory an MMapDirectory?

2015-10-07 Thread Eric Torti
in this post about the use of virtual memory? [http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html] Thanks! Best, Eric Torti

Re: Is solr.StandardDirectoryFactory an MMapDirectory?

2015-10-07 Thread Eric Torti
5min. So our scenario is not near real time in that sense. In light of this, do you thing using NRTCachingDirectory is still convenient? Best, Eric On Wed, Oct 7, 2015 at 12:08 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 10/7/2015 8:48 AM, Eric Torti wrote: >> > class="${so

Re: Is solr.StandardDirectoryFactory an MMapDirectory?

2015-10-07 Thread Eric Torti
Correcting: When I mentioned high non-JVM memory usage, what I probably meant was high virtual memory allocation. On Wed, Oct 7, 2015 at 3:00 PM, Eric Torti <ericzu...@gmail.com> wrote: > Thanks, Shawn. > >> After a look at the code, I found that StandardDirectoryFactory

Solr 5.2.1 - ReplicationHandler - No route to a host that is long gone

2015-10-06 Thread Eric Torti
Hey guys! We have a deploy of SolrCloud 5.2.1 that is composed of 5 to 8 amazon linux ec2 c3.2xlarge instances. Our main core is composed of 4M docs (6GB) and we serve an average of 70 req/s per machine. We are using zookeeper 3.4.6 to provide cluster synchronization. The thing is we are