Re: Re: Config for massive inserts into Solr master

2016-10-12 Thread Reinhard Budenstecher
> That is not correct as of version 4.0. > > The only kind of update I've run into that cannot proceed at the same > time as an optimize is a deleteByQuery operation. If you do that, then > it will block until the optimize is done, and I think it will also block > > any update you do after it. >

Re: Re: Config for massive inserts into Solr master

2016-10-11 Thread Reinhard Budenstecher
> > That's considerably larger than you initially indicated. In just one > index, you've got almost 300 million docs taking up well over 200GB. > About half of them have been deleted, but they are still there. Those > deleted docs *DO* affect operation and memory usage. > > Getting rid of deleted

Re: Re: Re: Config for massive inserts into Solr master

2016-10-10 Thread Reinhard Budenstecher
> > Just a sanity check. That directory mentioned, what kind of file system is > that on? NFS, NAS, RAID? I'm using Ext4 with options "noatime,nodiratime,barrier=0" on a hardware RAID10 with 4 SSD disks __ Gesendet mit Maills.de - mehr als n

Re: Re: Config for massive inserts into Solr master

2016-10-10 Thread Reinhard Budenstecher
> > What I have been hoping to see is the exact text of an OutOfMemoryError > in solr.log so I can tell whether it's happening because of heap space > or some other problem, like stack space. The stacktrace on such an > error might be helpfultoo. > Hi, I did understand what you need, I'm newbie

Re: Re: Config for massive inserts into Solr master

2016-10-10 Thread Alexandre Rafalovitch
Just a sanity check. That directory mentioned, what kind of file system is that on? NFS, NAS, RAID? Regards, Alex On 10 Oct 2016 1:09 AM, "Reinhard Budenstecher" wrote: > > That's considerably larger than you initially indicated. In just one > index, you've got almost 300 million docs taki

Re: Re: Config for massive inserts into Solr master

2016-10-09 Thread Reinhard Budenstecher
> > That's considerably larger than you initially indicated. In just one > index, you've got almost 300 million docs taking up well over 200GB. > About half of them have been deleted, but they are still there. Those > deleted docs *DO* affect operation and memory usage. > Yes, that's larger than

Re: Re: Config for massive inserts into Solr master

2016-10-09 Thread Reinhard Budenstecher
> What version of Solr? How has it been installed and started? > Solr 6.2.1 on Debian Jessie, installed with: apt-get install openjdk-8-jre-headless openjdk-8-jdk-headless wget "http://www.eu.apache.org/dist/lucene/solr/6.2.1/solr-6.2.1.tgz"; && tar xvfz solr-*.tgz ./solr-*/bin/install_solr_ser