Re: SolrCore Initialization Failures

2018-06-13 Thread shefalid
Thanks for your response.

None of the processes are deleting any index files.
One data directory is only pointed by one core.

We are writing data at a high ingestion rate (100,000 records per second).
Commit happens once every 30 seconds.

Also a periodic service runs to backup the data to our backup data store.
This service starts by saving commit point & when its done, it released the
commit point.

Could this combination of these factors some how cause the deletion of
files?



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html


Re: SolrCore Initialization Failures

2018-06-13 Thread shefalid
Thanks for your response.

None of the processes are deleting any index files.
One data directory is only pointed by one core.

We are writing data at a high ingestion rate (100,000 records per second).
Commit happens once every 30 seconds.

Also a periodic service runs to backup the data to our backup data store.
This service starts by saving commit point & when its done, it released the
commit point.

Could this combination of these factors some how cause the deletion of
files?



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html


SolrCore Initialization Failures

2018-06-11 Thread shefalid
Hi,

I am using solr 7.2.1
Every now & then some of the cores fail to load due to "SolrCore
Initialization Failure".
>From error message it looks like the reason for failure is the core missing
some of the files:

org.apache.solr.common.SolrException:org.apache.solr.common.SolrException:
Error opening new searcher
Caused by: java.nio.file.NoSuchFileException:
/opt/solr/volumes/data1/xxx-core-5/index/_xxx.cfe

But I could not find any reason for the loss of these files.
Also downloading the missing files from the backup we maintain resolves this
issue.
Any idea what might be causing this?

Thanks




--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html


Determining replication status

2018-03-31 Thread shefalid
I am trying to copy contents of one core to other core by using fetchIndex
command
(/solr/CORE_NAME/replication?command=fetchindex=MASTER_URL).

How can I determine if the copy is actually complete?

I am using replication details command
(/solr/CORE_NAME/replication?command=details) to check. I use isReplicating
field & if its false, I consider the operation to be complete. But this
approach is not giving me accurate results some time.



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html


CoreDescriptor not found in CoreCache

2018-01-30 Thread shefalid
I am using solr 6.6.2. In case of an init failure in core, CoreDescriptor of
such a core is not present in the core cache
(TransientSolrCoreCacheDefault). Is this behavior expected?



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html