[
https://issues.apache.org/jira/browse/SOLR-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16059688#comment-16059688
]
Varun Thacker commented on SOLR-10937:
--------------------------------------
Hi Matthew,
The AnalyzingSuggester uses a tmp dir to build the FST (
https://lucene.apache.org/core/6_6_0/suggest/org/apache/lucene/search/suggest/analyzing/AnalyzingSuggester.html
) and then deletes the tmp dir once it's built.
So this has nothing to do with your disk space on your normal drive but with
the tmp dir that the JVM is using.
The suggester doesn't let you specify the tmp in the solrconfig file , but the
dir path read by this System Property ( -Djava.io.tmpdir ) which defaults Java
defaults to /tmp on linux I believe
Maybe we could do two things here to help the user:
- Mention the path which run out of disk space
- Document that the AnalyzingSuggester/FuzzySuggester requires a tmp dir to
build the suggester.
We could leave this Jira open to address those. Would you be interested in
submitting a patch?
> No space left on device when building suggester index
> -----------------------------------------------------
>
> Key: SOLR-10937
> URL: https://issues.apache.org/jira/browse/SOLR-10937
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Components: Suggester
> Affects Versions: 6.6
> Environment: Ubuntu 16
> java version "1.8.0_131"
> Java(TM) SE Runtime Environment (build 1.8.0_131-b11)
> Java HotSpot(TM) 64-Bit Server VM (build 25.131-b11, mixed mode)
> Reporter: Matthew Caruana Galizia
> Labels: filesystem, suggester
>
> On startup, I see the following error in my logs even though the disk has
> 600GB of free space available (and 3GB on the root filesystem):
> {code:java}
> 2017-06-22 08:53:01.862 ERROR (searcherExecutor-8-thread-1-processing-x:kc) [
> x:kc] o.a.s.h.c.SuggestComponent Exception in building suggester index for:
> suggester
> java.io.IOException: No space left on device
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
> at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
> at sun.nio.ch.IOUtil.write(IOUtil.java:65)
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
> at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
> at java.nio.channels.Channels.writeFully(Channels.java:101)
> at java.nio.channels.Channels.access$000(Channels.java:61)
> at java.nio.channels.Channels$1.write(Channels.java:174)
> at
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
> at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
> at
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
> at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
> at
> org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(OutputStreamIndexOutput.java:53)
> at
> org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:524)
> at
> org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:499)
> at
> org.apache.lucene.util.OfflineSorter$SortPartitionTask.call(OfflineSorter.java:612)
> at
> org.apache.lucene.util.OfflineSorter$SortPartitionTask.call(OfflineSorter.java:588)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> org.apache.lucene.util.SameThreadExecutorService.execute(SameThreadExecutorService.java:34)
> at
> java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
> at org.apache.lucene.util.OfflineSorter.sort(OfflineSorter.java:285)
> at
> org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(AnalyzingSuggester.java:489)
> at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)
> at
> org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:181)
> at
> org.apache.solr.handler.component.SuggestComponent$SuggesterListener.buildSuggesterIndex(SuggestComponent.java:524)
> at
> org.apache.solr.handler.component.SuggestComponent$SuggesterListener.newSearcher(SuggestComponent.java:506)
> at
> org.apache.solr.core.SolrCore.lambda$getSearcher$15(SolrCore.java:2249)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:748)
> Suppressed: java.io.IOException: No space left on device
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
> at
> sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
> at sun.nio.ch.IOUtil.write(IOUtil.java:65)
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
> at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
> at java.nio.channels.Channels.writeFully(Channels.java:101)
> at java.nio.channels.Channels.access$000(Channels.java:61)
> at java.nio.channels.Channels$1.write(Channels.java:174)
> at
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
> at
> java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
> at
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
> at
> java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
> at
> org.apache.lucene.store.OutputStreamIndexOutput.close(OutputStreamIndexOutput.java:68)
> at
> org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.close(OfflineSorter.java:532)
> at
> org.apache.lucene.util.OfflineSorter$SortPartitionTask.call(OfflineSorter.java:622)
> ... 16 more
> Suppressed: java.io.IOException: No space left on device
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
> at
> sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
> at
> sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
> at sun.nio.ch.IOUtil.write(IOUtil.java:65)
> at
> sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
> at
> java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
> at
> java.nio.channels.Channels.writeFully(Channels.java:101)
> at
> java.nio.channels.Channels.access$000(Channels.java:61)
> at java.nio.channels.Channels$1.write(Channels.java:174)
> at
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
> at
> java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
> at
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
> at
> java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
> at
> java.io.FilterOutputStream.close(FilterOutputStream.java:158)
> at
> org.apache.lucene.store.OutputStreamIndexOutput.close(OutputStreamIndexOutput.java:70)
> ... 18 more
> Suppressed: java.nio.channels.ClosedChannelException
> at
> sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:110)
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:199)
> at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
> at java.nio.channels.Channels.writeFully(Channels.java:101)
> at java.nio.channels.Channels.access$000(Channels.java:61)
> at java.nio.channels.Channels$1.write(Channels.java:174)
> at
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
> at
> java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
> at
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
> at
> java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
> at
> org.apache.lucene.store.OutputStreamIndexOutput.close(OutputStreamIndexOutput.java:70)
> at
> org.apache.lucene.util.OfflineSorter$SortPartitionTask.call(OfflineSorter.java:622)
> ... 16 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
