[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-15 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12845391#action_12845391 ] Michael Busch commented on LUCENE-2293: --- I'll reply on LUCENE-2324. > IndexWriter h

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-15 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12845263#action_12845263 ] Michael McCandless commented on LUCENE-2293: bq. For example, currently a nic

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-14 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12845190#action_12845190 ] Michael Busch commented on LUCENE-2293: --- OK I opened LUCENE-2324. We can close this

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-14 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12845159#action_12845159 ] Michael Busch commented on LUCENE-2293: --- bq. How about a new issue? OK, will open o

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-14 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12845056#action_12845056 ] Michael McCandless commented on LUCENE-2293: bq. Or do you want to commit the

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-14 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12845048#action_12845048 ] Michael Busch commented on LUCENE-2293: --- I'm tempted to get rid of the pooling for P

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-14 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12845047#action_12845047 ] Michael Busch commented on LUCENE-2293: --- {quote} but does anyone out there wanna wor

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-13 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844926#action_12844926 ] Jason Rutherglen commented on LUCENE-2293: -- bq. Probably one DW instance per thre

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-13 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844900#action_12844900 ] Michael McCandless commented on LUCENE-2293: Probably one DW instance per thre

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-13 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844893#action_12844893 ] Jason Rutherglen commented on LUCENE-2293: -- {quote}Change the approach for how we

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-13 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844848#action_12844848 ] Michael McCandless commented on LUCENE-2293: I think this issue has these step

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-12 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844828#action_12844828 ] Jason Rutherglen commented on LUCENE-2293: -- {quote}but does anyone out there wann

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-05 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841960#action_12841960 ] Jason Rutherglen commented on LUCENE-2293: -- {quote}I think we have two options he

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-05 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841942#action_12841942 ] Shai Erera commented on LUCENE-2293: Thanks Michael. If the int[] are per DW then it's

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-05 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841923#action_12841923 ] Michael Busch commented on LUCENE-2293: --- bq. So about the int[], would that be of th

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-05 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841915#action_12841915 ] Michael Busch commented on LUCENE-2293: --- {quote} This is a great approach for speedi

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-05 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841821#action_12841821 ] Shai Erera commented on LUCENE-2293: Michael - I see that we were on the same page. Pr

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-05 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841800#action_12841800 ] Michael McCandless commented on LUCENE-2293: bq. I think in the future deletes

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-05 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841745#action_12841745 ] Michael Busch commented on LUCENE-2293: --- {quote} Won't this complicate the entire so

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-05 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841744#action_12841744 ] Michael Busch commented on LUCENE-2293: --- {quote} But if each DW maintains its own do

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841697#action_12841697 ] Shai Erera commented on LUCENE-2293: But if each DW maintains its own doc IDs, separat

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841617#action_12841617 ] Michael Busch commented on LUCENE-2293: --- bq. The big advantage is that all (re)opene

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841545#action_12841545 ] Michael Busch commented on LUCENE-2293: --- {quote} I thought that when (3) happens, th

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841463#action_12841463 ] Shai Erera commented on LUCENE-2293: What about the following scenario: # A document i

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841407#action_12841407 ] Michael Busch commented on LUCENE-2293: --- bq. Yes, I think each DW will have to recor

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841395#action_12841395 ] Michael McCandless commented on LUCENE-2293: bq. Cool! I wasn't sure if you wa

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841388#action_12841388 ] Michael Busch commented on LUCENE-2293: --- {quote} But, I was proposing a bigger chang

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841347#action_12841347 ] Michael McCandless commented on LUCENE-2293: Yes, I think each DW will have to

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841342#action_12841342 ] Jason Rutherglen commented on LUCENE-2293: -- bq. But WaitQueue would go away with

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841235#action_12841235 ] Shai Erera commented on LUCENE-2293: Perhaps instead of buffering the delete Terms/Que

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841225#action_12841225 ] Michael McCandless commented on LUCENE-2293: I agree IW should not spawn its o

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841193#action_12841193 ] Earwin Burrfoot commented on LUCENE-2293: - bq. I wonder if that won't complicate I

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841140#action_12841140 ] Shai Erera commented on LUCENE-2293: Ok so I think I understand now. You propose to ch

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841135#action_12841135 ] Michael Busch commented on LUCENE-2293: --- Sorry - after reading my comment again I ca

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841127#action_12841127 ] Shai Erera commented on LUCENE-2293: bq. What I described is not much different from w

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-04 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841120#action_12841120 ] Michael Busch commented on LUCENE-2293: --- {quote} Also, in the pull approach, Lucene

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-03 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841106#action_12841106 ] Shai Erera commented on LUCENE-2293: bq. The IndexWriter (or a new class) would have t

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-03 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840952#action_12840952 ] Michael Busch commented on LUCENE-2293: --- bq. I hope we won't lose monotonic docIDs f

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-03 Thread Earwin Burrfoot (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840949#action_12840949 ] Earwin Burrfoot commented on LUCENE-2293: - bq. The IndexWriter (or a new class) wo

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840918#action_12840918 ] Jason Rutherglen commented on LUCENE-2293: -- Mike, good one! Would having a doc i

[jira] Commented: (LUCENE-2293) IndexWriter has hard limit on max concurrency

2010-03-03 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840911#action_12840911 ] Michael Busch commented on LUCENE-2293: --- Good timing - a couple days ago I was think