[ https://issues.apache.org/jira/browse/LUCENE-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854615#action_12854615 ]
Michael McCandless commented on LUCENE-2380: -------------------------------------------- We could also do shared byte[] blocks (private), with a public method to retrieve the BytesRef for a given doc? Standard codec's terms index does this -- we could share it I think. A new byte[] per doc adds alot of RAM overhead and GC load. (Of course, so does the String solution we use today, so it'd at least be no worse...). > Add FieldCache.getTermBytes, to load term data as byte[] > -------------------------------------------------------- > > Key: LUCENE-2380 > URL: https://issues.apache.org/jira/browse/LUCENE-2380 > Project: Lucene - Java > Issue Type: Improvement > Reporter: Michael McCandless > Fix For: 3.1 > > > With flex, a term is now an opaque byte[] (typically, utf8 encoded unicode > string, but not necessarily), so we need to push this up the search stack. > FieldCache now has getStrings and getStringIndex; we need corresponding > methods to load terms as native byte[], since in general they may not be > representable as String. This should be quite a bit more RAM efficient too, > for US ascii content since each character would then use 1 byte not 2. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org For additional commands, e-mail: java-dev-h...@lucene.apache.org