Re: SolR 5.3.1 deletes index files

2016-01-18 Thread Moll, Dr. Andreas
> I still think you should look at ensuring your merge policy is turned off >in solrconfig.xml (if I understand your scenario, you have 1 instance which >is read-only for searching, and another writing to the same index >location), and did your turn infostream on as Erick suggested? Thank you for

Re: SolR 5.3.1 deletes index files

2016-01-15 Thread Moll, Dr. Andreas
Hi, we still have the problem that SolR deletes index files on closing the application if the index was changed in the meantime from the production application (which has an embedded SolR-Server). The problem also occurs if we use a local file system instead of a NFS. I have changed the loglevel

Re: SolR 5.3.1 deletes index files

2016-01-15 Thread Daniel Collins
Can I just clarify something. The title of this thread implies Solr is losing data when it shuts down which would be really bad(!) The core isn't deleting any data, it is performing a merge, so the data exists, just in fewer larger segments instead of all the smaller segments you had before. So

Re: SolR 5.3.1 deletes index files

2016-01-15 Thread Daniel Collins
I know Solr used to have issues with indexes on NFS, there was a segments.gen file specifically for issues around that, though that was removed in 5.0. But you say this happens on local disks too, so that would rule NFS out of it. I still think you should look at ensuring your merge policy is

Re: SolR 5.3.1 deletes index files

2016-01-15 Thread Moll, Dr. Andreas
Hi, If you look at the files at the ls-Output in my last post you will see that SolR has deleted the segments_f -file. Thus the index can no longer be loaded. I also had other cases in which the data directory of SolR was empty after the SolR shutdown. And yes, it ist bad. Best regards

RE: SolR 5.3.1 deletes index files

2015-12-18 Thread Moll, Dr. Andreas
Hi Shawn, >To figure out what's going on, we will need information about your >server, exactly how you installed Solr, how it is started, how it is >stopped, etc. thanks for your interest in our problem. I currently start SolR on Linux via solr-5.3.1/bin/solr start -f because we are still in

Re: SolR 5.3.1 deletes index files

2015-12-18 Thread Erick Erickson
Andreas: Let me see if I understand correctly: You have two Solr instances pointing at the _same_ NFS-mounted directory. The lock type of "single" implies this. And you're totally and absolutely sure that only _one_ Solr instance writes to that directory _ever_, right? It's not even the case that

SolR 5.3.1 deletes index files

2015-12-17 Thread Moll, Dr. Andreas
Hi, we are using SolR for some years now and are currently switching from SolR 3.6 to 5.3.1. SolR 5.3.1 deletes all index files when it shuts down and there were external changes on the index-files (in our case from a second SolR-server which produces the index). Is this behaviour intentional?

Re: SolR 5.3.1 deletes index files

2015-12-17 Thread Shawn Heisey
On 12/17/2015 8:00 AM, Moll, Dr. Andreas wrote: > we are using SolR for some years now and are currently switching from SolR > 3.6 to 5.3.1. > SolR 5.3.1 deletes all index files when it shuts down and there were external > changes on the index-files > (in our case from a second SolR-server which