There's not much you can do, you either need to delete some data or increase your disk space.
Maybe someone can clarify how much space is needed for a merge, but I imagine it'd be twice the size of a shard. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [email protected] web: www.campaignmonitor.com On 26 March 2014 22:01, Ivan Ji <[email protected]> wrote: > Hi Mark, > > My index size is about 300GB, the free disk space is about 5G. > > > > Mark Walkom於 2014年3月26日星期三UTC+8下午6時18分12秒寫道： >> >> Depends on how much data you have. >> >> How much disk space is on the machine? How much data is in ES? >> >> Regards, >> Mark Walkom >> >> Infrastructure Engineer >> Campaign Monitor >> email: [email protected] >> web: www.campaignmonitor.com >> >> >> On 26 March 2014 21:06, Ivan Ji <[email protected]> wrote: >> >>> I just looked up the lucene's document. during the merge, there at least >>> need double the index size. >>> But does ES tune something on it ? or it just follow the lucene's rule, >>> that is 2x the index size. >>> >>> Ivan Ji於 2014年3月26日星期三UTC+8下午5時53分33秒寫道： >>> >>>> Hi all, >>>> >>>> I am using ES 1.0.1. I am wondering how many un-used disk space needed >>>> for the ES's system running? >>>> >>>> Because I ran into the error: >>>> >>>> [2014-03-26 03:30:52,713][WARN ][index.merge.scheduler ] [Rick >>>>> Jones] [qusion][1] failed to merge >>>>> java.io.IOException: No space left on device >>>>> at java.io.RandomAccessFile.writeBytes0(Native Method) >>>>> at java.io.RandomAccessFile.writeBytes(RandomAccessFile.java:520) >>>>> at java.io.RandomAccessFile.write(RandomAccessFile.java:550) >>>>> at org.apache.lucene.store.FSDirectory$FSIndexOutput.flushBuffe >>>>> r(FSDirectory.java:458) >>>>> at org.apache.lucene.store.RateLimitedFSDirectory$RateLimitedIn >>>>> dexOutput.flushBuffer(RateLimitedFSDirectory.java:102) >>>>> at org.apache.lucene.store.BufferedChecksumIndexOutput.flushBuffer( >>>>> BufferedChecksumIndexOutput.java:71) >>>>> at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(Buff >>>>> eredIndexOutput.java:113) >>>>> at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIn >>>>> dexOutput.java:102) >>>>> at org.apache.lucene.store.BufferedChecksumIndexOutput.flush(Bu >>>>> fferedChecksumIndexOutput.java:86) >>>>> at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIn >>>>> dexOutput.java:126) >>>>> at org.apache.lucene.store.BufferedChecksumIndexOutput.close(Bu >>>>> fferedChecksumIndexOutput.java:61) >>>>> at org.elasticsearch.index.store.Store$StoreIndexOutput.close(S >>>>> tore.java:602) >>>>> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWr >>>>> iter.close(CompressingStoredFieldsIndexWriter.java:205) >>>>> at org.apache.lucene.util.IOUtils.close(IOUtils.java:140) >>>>> at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter. >>>>> close(CompressingStoredFieldsWriter.java:138) >>>>> at org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMer >>>>> ger.java:318) >>>>> at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:94) >>>>> at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter. >>>>> java:4071) >>>>> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3668) >>>>> at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(Con >>>>> currentMergeScheduler.java:405) >>>>> at org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge( >>>>> TrackingConcurrentMergeScheduler.java:107) >>>>> at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run( >>>>> ConcurrentMergeScheduler.java:482) >>>>> [2014-03-26 03:30:53,382][WARN ][index.engine.internal ] [Rick >>>>> Jones] [qusion][1] failed engine >>>> >>>> >>>> >>>> Obviously, there need to have some amount of disk during the merge. >>>> And I think the larger index size, the more disk space needed for the >>>> merge operation. >>>> >>>> Does anyone have the idea how much does it can be? >>>> >>>> Ivan >>>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To view this discussion on the web visit https://groups.google.com/d/ >>> msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f% >>> 40googlegroups.com<https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com<https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624YiasugLk6L9SsMoESOJvfUA3FzGwKJk0mTDe-FRHSy2Q%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
