[
https://issues.apache.org/jira/browse/LUCENE-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Muir updated LUCENE-3291:
--------------------------------
Attachment: LUCENE-3291_test.patch
here's the test, it indexes 26 terms (a..z) per doc about 80M times to create
just over Integer.MAX_VALUE t-d pairs.
with memorycodec (ant test-core -Dtestcase=Test2BPostings -Dtests.codec=Memory)
it fails like this:
{noformat}
[junit] Caused by: java.lang.ArrayIndexOutOfBoundsException
[junit] at java.lang.System.arraycopy(Native Method)
[junit] at
org.apache.lucene.util.fst.FST$BytesWriter.writeBytes(FST.java:855)
[junit] at
org.apache.lucene.util.fst.ByteSequenceOutputs.write(ByteSequenceOutputs.java:113)
[junit] at
org.apache.lucene.util.fst.ByteSequenceOutputs.write(ByteSequenceOutputs.java:32)
[junit] at org.apache.lucene.util.fst.FST.addNode(FST.java:401)
[junit] at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:120)
[junit] at
org.apache.lucene.util.fst.Builder.compileNode(Builder.java:153)
[junit] at org.apache.lucene.util.fst.Builder.finish(Builder.java:440)
[junit] at
org.apache.lucene.index.codecs.memory.MemoryCodec$TermsWriter.finish(MemoryCodec.java:228)
{noformat}
> bugs in memorycodec with lots of docs
> -------------------------------------
>
> Key: LUCENE-3291
> URL: https://issues.apache.org/jira/browse/LUCENE-3291
> Project: Lucene - Java
> Issue Type: Bug
> Components: core/codecs
> Affects Versions: 4.0
> Reporter: Robert Muir
> Attachments: LUCENE-3291_test.patch
>
>
> While working on LUCENE-3290, I noticed a readVint that i thought should be a
> readVLong, so I wrote a test (Test2BPostings)
> to try to catch things like this... it takes about 5 minutes to run with
> MemoryCodec.
> The problem is, it dies on some other bug in FSTs first!
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
