[
https://issues.apache.org/jira/browse/LUCENENET-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265773#comment-13265773
]
Steven commented on LUCENENET-488:
----------------------------------
Hi Simon, thanks very much, set the option to 10 (have no idea what that means
but it works) the reader open in about 4 seconds but the search is still hugely
impressive (300ms to search through 1bn records and return the first 10).
I will try to build a native 64bit version on the server itself (my development
box is only 32 which might be the problem) and let you know how I get on.
Thanks again, can't believe you guys do this for free, I pay millions for
products that aren't any where near as good!
> Can't open IndexReader, get OutOFMemory Exception
> -------------------------------------------------
>
> Key: LUCENENET-488
> URL: https://issues.apache.org/jira/browse/LUCENENET-488
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core
> Affects Versions: Lucene.Net 2.9.4g
> Environment: Windows server 2008R2
> Reporter: Steven
>
> Have build a large database with ~1Bn records (2 items per document) it has
> size 200GB on disk. I managed to write the indexe by chunking into 100,000
> blocks as I ended up with some threading issues (another bug submission).
> Anyway the index is built but I can't open it and get a memory exception
> (process explorer gets to 1.5GB allocated before it dies but not sure how
> reliable that is, but do know there is plenty more RAM left on the box).
> Stack trace below:
> System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException'
> was
> thrown.
> at Lucene.Net.Index.TermInfosReader..ctor(Directory dir, String seg,
> FieldInf
> os fis, Int32 readBufferSize, Int32 indexDivisor)
> at Lucene.Net.Index.SegmentReader.CoreReaders..ctor(SegmentReader
> origInstanc
> e, Directory dir, SegmentInfo si, Int32 readBufferSize, Int32
> termsIndexDivisor)
> at Lucene.Net.Index.SegmentReader.Get(Boolean readOnly, Directory dir,
> Segmen
> tInfo si, Int32 readBufferSize, Boolean doOpenStores, Int32
> termInfosIndexDiviso
> r)
> at Lucene.Net.Index.SegmentReader.Get(Boolean readOnly, SegmentInfo si,
> Int32
> termInfosIndexDivisor)
> at Lucene.Net.Index.DirectoryReader..ctor(Directory directory,
> SegmentInfos s
> is, IndexDeletionPolicy deletionPolicy, Boolean readOnly, Int32
> termInfosIndexDi
> visor)
> at Lucene.Net.Index.DirectoryReader.<>c__DisplayClass1.<Open>b__0(String
> segm
> entFileName)
> at Lucene.Net.Index.SegmentInfos.FindSegmentsFile.Run(IndexCommit commit)
> at Lucene.Net.Index.DirectoryReader.Open(Directory directory,
> IndexDeletionPo
> licy deletionPolicy, IndexCommit commit, Boolean readOnly, Int32
> termInfosIndexD
> ivisor)
> at Lucene.Net.Index.IndexReader.Open(String path, Boolean readOnly)
> at Lucene.Net.Demo.SearchFiles.Main(String[] args)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
