[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-31 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568108#comment-13568108 ] Robert Muir commented on LUCENE-4682: - {quote} Not sure exactly what to conclude

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-30 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567367#comment-13567367 ] Robert Muir commented on LUCENE-4682: - There's a pretty interesting approach here

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-30 Thread Dawid Weiss (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13567434#comment-13567434 ] Dawid Weiss commented on LUCENE-4682: - Yep, it's similar to what I was suggesting --

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-18 Thread Commit Tag Bot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13557229#comment-13557229 ] Commit Tag Bot commented on LUCENE-4682: [branch_4x commit] Robert Muir

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-14 Thread Dawid Weiss (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552497#comment-13552497 ] Dawid Weiss commented on LUCENE-4682: - Yeah, there are many ideas layered on top of

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-14 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552614#comment-13552614 ] Michael McCandless commented on LUCENE-4682: I tried removing NEXT opto in

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-14 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552619#comment-13552619 ] Robert Muir commented on LUCENE-4682: - {quote} So FST would be ~39% larger if we

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-14 Thread Dawid Weiss (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552624#comment-13552624 ] Dawid Weiss commented on LUCENE-4682: - bq. I also tested delta-coding the arc target

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-14 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552633#comment-13552633 ] Michael McCandless commented on LUCENE-4682: {quote} bq. So FST would be ~39%

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-14 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552641#comment-13552641 ] Robert Muir commented on LUCENE-4682: - {quote} Wait: the 28% waste comes from the

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-14 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552653#comment-13552653 ] Michael McCandless commented on LUCENE-4682: bq. I mean in general

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-13 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552184#comment-13552184 ] Michael McCandless commented on LUCENE-4682: OK I ran several performance

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-13 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552189#comment-13552189 ] Robert Muir commented on LUCENE-4682: - Well, i think actually we shouldnt allow 25%

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-13 Thread Dawid Weiss (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552218#comment-13552218 ] Dawid Weiss commented on LUCENE-4682: - bq. I think if it would be too wasteful (e.g.

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-13 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552374#comment-13552374 ] Robert Muir commented on LUCENE-4682: - I agree: about the code complication, its hard

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551932#comment-13551932 ] Michael McCandless commented on LUCENE-4682: A couple more ideas: * Since

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551934#comment-13551934 ] Michael McCandless commented on LUCENE-4682: Maybe we should just tighten up

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551938#comment-13551938 ] Robert Muir commented on LUCENE-4682: - As an experiment i turned off array arcs for

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551939#comment-13551939 ] Michael McCandless commented on LUCENE-4682: Even more than the 271,187 I

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551940#comment-13551940 ] Robert Muir commented on LUCENE-4682: - in the fixedArray case: {code} // write a

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Dawid Weiss (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551944#comment-13551944 ] Dawid Weiss commented on LUCENE-4682: - bq. Even more than the 271,187 I measured (20%

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551950#comment-13551950 ] Michael McCandless commented on LUCENE-4682: Another datapoint: the FreeDB

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552057#comment-13552057 ] Michael McCandless commented on LUCENE-4682: +1 This is much cleaner (write

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552061#comment-13552061 ] Robert Muir commented on LUCENE-4682: - I can cleanup+commit the patch with the

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552063#comment-13552063 ] Michael McCandless commented on LUCENE-4682: +1 Reduce

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Dawid Weiss (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552065#comment-13552065 ] Dawid Weiss commented on LUCENE-4682: - +1. Nice. Reduce wasted

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552067#comment-13552067 ] Uwe Schindler commented on LUCENE-4682: --- +1 Reduce wasted bytes

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552071#comment-13552071 ] Robert Muir commented on LUCENE-4682: - ok i committed the vInt for maxBytesPerArc,

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Commit Tag Bot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552072#comment-13552072 ] Commit Tag Bot commented on LUCENE-4682: [trunk commit] Robert Muir

[jira] [Commented] (LUCENE-4682) Reduce wasted bytes in FST due to array arcs

2013-01-12 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552075#comment-13552075 ] Robert Muir commented on LUCENE-4682: - Another simple idea: instead of boolean