[jira] Commented: (LUCENE-806) Synchronization bottleneck in FieldSortedHitQueue with many concurrent readers

2007-04-03 Thread Paul Cowan (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486252 ] Paul Cowan commented on LUCENE-806: --- Otis, you're probably right -- it may not be wise to tackle two birds with one

[jira] Updated: (LUCENE-806) Synchronization bottleneck in FieldSortedHitQueue with many concurrent readers

2007-04-03 Thread Paul Cowan (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Cowan updated LUCENE-806: -- Attachment: LUCENE-806-minimal-usealways.patch Minimal ThreadLocal wrapper, Implementation #1: an alway

[jira] Updated: (LUCENE-806) Synchronization bottleneck in FieldSortedHitQueue with many concurrent readers

2007-04-03 Thread Paul Cowan (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Cowan updated LUCENE-806: -- Attachment: LUCENE-806-minimal-systemproperty.patch Minimal ThreadLocal wrapper, Implementation #2: bas

[jira] Updated: (LUCENE-806) Synchronization bottleneck in FieldSortedHitQueue with many concurrent readers

2007-04-03 Thread Paul Cowan (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Cowan updated LUCENE-806: -- Attachment: LUCENE-806-minimal-publicapi.patch Minimal ThreadLocal wrapper, Implementation #3: public s

[jira] Commented: (LUCENE-843) improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486293 ] Michael McCandless commented on LUCENE-843: --- To do the benchmarking I created a simple standalone tool (dem

[jira] Commented: (LUCENE-843) improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486292 ] Michael McCandless commented on LUCENE-843: --- Some details on how I measure RAM usage: both the baseline (cu

[jira] Commented: (LUCENE-843) improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486332 ] Michael McCandless commented on LUCENE-843: --- A couple more details on the testing: I run java -server to ge

[jira] Commented: (LUCENE-843) improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486334 ] Michael McCandless commented on LUCENE-843: --- Here are the results for "normal" sized docs (1K tokens = ~5,5

[jira] Commented: (LUCENE-843) improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486335 ] Michael McCandless commented on LUCENE-843: --- Last is the results for small docs (100 tokens = ~550 bytes p

[jira] Commented: (LUCENE-843) improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486339 ] Michael McCandless commented on LUCENE-843: --- A few notes from these results: * A real Lucene app won't s

[jira] Commented: (LUCENE-843) improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Marvin Humphrey (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486373 ] Marvin Humphrey commented on LUCENE-843: > The actual HEAP RAM usage is quite a bit more > stable with the

Re: [jira] Commented: (LUCENE-843) improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Ning Li
On 4/3/07, Michael McCandless (JIRA) <[EMAIL PROTECTED]> wrote: * With term vectors and/or stored fields, the new patch has substantially better RAM efficiency. Impressive numbers! The new patch improves RAM efficiency quite a bit even with no term vectors nor stored fields, because of the

Re: improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Yonik Seeley
Wow, very nice results Mike! -Yonik On 4/3/07, Michael McCandless (JIRA) <[EMAIL PROTECTED]> wrote: [ https://issues.apache.org/jira/browse/LUCENE-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486335 ] Michael McCandless commented on LUCENE-843:

[jira] Commented: (LUCENE-843) improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486385 ] Michael McCandless commented on LUCENE-843: --- >> The actual HEAP RAM usage is quite a bit more >> stable wi

Re: [jira] Commented: (LUCENE-843) improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Michael McCandless
"Ning Li" <[EMAIL PROTECTED]> wrote: > On 4/3/07, Michael McCandless (JIRA) <[EMAIL PROTECTED]> wrote: > > > * With term vectors and/or stored fields, the new patch has > >substantially better RAM efficiency. > > Impressive numbers! The new patch improves RAM efficiency quite a bit > even w

Re: improve how IndexWriter uses RAM to buffer added documents

2007-04-03 Thread Michael McCandless
"Yonik Seeley" <[EMAIL PROTECTED]> wrote: > Wow, very nice results Mike! Thanks :) I'm just praying I don't have some sneaky bug making the results far better than they really are!! And still plenty to do... Mike - To unsubsc

publish to maven-repository

2007-04-03 Thread Joerg Hohwiller
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi there, I will give it another try: Could you please publish lucene 2.* artifacts (including contribs) to the maven2 repository at ibiblio? Currently there is only the lucene-core available up to version 2.0.0: http://repo1.maven.org/maven2/org/ap