Re: snapinstaller does not start newSearcher
I have used snapshotter api and modified snapinstaller script, so that it successfully grabs the snapshot folder and updates index folder in slave. However, it fails to open newSearcher. It simple, sends a commit command to slave, but hasUncommittedChanges function returns false. That is the reason. Reloading collection picks up changes. Could reloading return no results for queries that were sent during this process? Thanks. Alex. -- View this message in context: http://lucene.472066.n3.nabble.com/snapinstaller-does-not-start-newSearcher-tp4188449p4191069.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: snapinstaller does not start newSearcher
Hello,
We cannot use replication with the current architecture, so decided to use
snapshotter with snapinstaller.
Here is the full stack trace
8937 [coreLoadExecutor-5-thread-3] INFO
org.apache.solr.core.CachingDirectoryFactory – Closing directory:
/home/solr/solr-4.10.1/solr/example/solr/product/data
8938 [coreLoadExecutor-5-thread-3] ERROR org.apache.solr.core.CoreContainer –
Error creating core [product]: Error opening new searcher
org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.(SolrCore.java:873)
at org.apache.solr.core.SolrCore.(SolrCore.java:646)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1565)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1677)
at org.apache.solr.core.SolrCore.(SolrCore.java:845)
... 9 more
Caused by: java.nio.file.NoSuchFileException:
/home/solr/solr-4.10.1/solr/example/solr/product/data/index/segments_4
at
sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at
sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176)
at java.nio.channels.FileChannel.open(FileChannel.java:287)
at java.nio.channels.FileChannel.open(FileChannel.java:334)
at
org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:196)
at
org.apache.lucene.store.NRTCachingDirectory.openInput(NRTCachingDirectory.java:198)
at
org.apache.lucene.store.Directory.openChecksumInput(Directory.java:113)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:341)
at org.apache.lucene.index.SegmentInfos$1.doBody(SegmentInfos.java:454)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:906)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:752)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:450)
at org.apache.lucene.index.IndexWriter.(IndexWriter.java:792)
at
org.apache.solr.update.SolrIndexWriter.(SolrIndexWriter.java:77)
at
org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:64)
at
org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:279)
at
org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:111)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1528)
... 11 more
8943 [main] INFO org.apache.solr.servlet.SolrDispatchFilter –
user.dir=/home/solr/solr-4.10.1/solr/example
8943 [main] INFO org.apache.solr.servlet.SolrDispatchFilter –
SolrDispatchFilter.init() done
8982 [main] INFO org.eclipse.jetty.server.AbstractConnector – Started
SocketConnector@0.0.0.0:8983
Thanks.
Alex.
-Original Message-
From: Shalin Shekhar Mangar
To: solr-user
Sent: Tue, Feb 24, 2015 12:13 am
Subject: Re: snapinstaller does not start newSearcher
Do you mean the snapinstaller (bash) script? Those are legacy scripts.
It's
been a long time since they were tested. The ReplicationHandler is
the
recommended way to setup replication. If you want to take a snapshot
then
the replication handler has an HTTP based API which lets you do
that.
In any case, do you have the full stack trace for that exception?
There
should be another cause nested under it.
On Tue, Feb 24, 2015 at 12:47
PM, wrote:
> Hello,
>
> I am using latest solr (solr
trunk) . I run snapinstaller, and see that it
> copies snapshot to index folder
but changes are not picked up and
>
> logs in slave after running
snapinstaller are
>
> 44302 [qtp1312571113-14] INFO
org.apache.solr.update.UpdateHandler –
> start
>
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
>
44303 [qtp1312571113-14] INFO org.apache.solr.update.UpdateHandler – No
>
uncommitted changes. Skipping IW.commit.
> 44304 [qtp1312571113-14] INFO
org.apache.solr.core.SolrCore –
> SolrIndexSearcher has not changed - not
re-open
Re: snapinstaller does not start newSearcher
Do you mean the snapinstaller (bash) script? Those are legacy scripts. It's
been a long time since they were tested. The ReplicationHandler is the
recommended way to setup replication. If you want to take a snapshot then
the replication handler has an HTTP based API which lets you do that.
In any case, do you have the full stack trace for that exception? There
should be another cause nested under it.
On Tue, Feb 24, 2015 at 12:47 PM, wrote:
> Hello,
>
> I am using latest solr (solr trunk) . I run snapinstaller, and see that it
> copies snapshot to index folder but changes are not picked up and
>
> logs in slave after running snapinstaller are
>
> 44302 [qtp1312571113-14] INFO org.apache.solr.update.UpdateHandler –
> start
> commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> 44303 [qtp1312571113-14] INFO org.apache.solr.update.UpdateHandler – No
> uncommitted changes. Skipping IW.commit.
> 44304 [qtp1312571113-14] INFO org.apache.solr.core.SolrCore –
> SolrIndexSearcher has not changed - not re-opening:
> org.apache.solr.search.SolrIndexSearcher
> 44305 [qtp1312571113-14] INFO org.apache.solr.update.UpdateHandler –
> end_commit_flush
> 44305 [qtp1312571113-14] INFO
> org.apache.solr.update.processor.LogUpdateProcessor – [product]
> webapp=/solr path=/update params={} {commit=} 0 57
>
> Restarting solr gives
>
> Error creating core [product]: Error opening new searcher
> org.apache.solr.common.SolrException: Error opening new searcher
> at org.apache.solr.core.SolrCore.(SolrCore.java:873)
> at org.apache.solr.core.SolrCore.(SolrCore.java:646)
> at
> org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
> at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
> at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
> at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
> Caused by: org.apache.solr.common.SolrException: Error opening new searcher
> at
> org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1565)
> at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1677)
> at org.apache.solr.core.SolrCore.(SolrCore.java:845)
> ... 9 more
>
> Any idea what causes this issue.
>
> Thanks in advance.
> Alex.
>
>
--
Regards,
Shalin Shekhar Mangar.
snapinstaller does not start newSearcher
Hello,
I am using latest solr (solr trunk) . I run snapinstaller, and see that it
copies snapshot to index folder but changes are not picked up and
logs in slave after running snapinstaller are
44302 [qtp1312571113-14] INFO org.apache.solr.update.UpdateHandler – start
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
44303 [qtp1312571113-14] INFO org.apache.solr.update.UpdateHandler – No
uncommitted changes. Skipping IW.commit.
44304 [qtp1312571113-14] INFO org.apache.solr.core.SolrCore –
SolrIndexSearcher has not changed - not re-opening:
org.apache.solr.search.SolrIndexSearcher
44305 [qtp1312571113-14] INFO org.apache.solr.update.UpdateHandler –
end_commit_flush
44305 [qtp1312571113-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor – [product] webapp=/solr
path=/update params={} {commit=} 0 57
Restarting solr gives
Error creating core [product]: Error opening new searcher
org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.(SolrCore.java:873)
at org.apache.solr.core.SolrCore.(SolrCore.java:646)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1565)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1677)
at org.apache.solr.core.SolrCore.(SolrCore.java:845)
... 9 more
Any idea what causes this issue.
Thanks in advance.
Alex.
