[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12929629#action_12929629 ] Jason Rutherglen commented on LUCENE-2680: -- I'm running test-core multiple times

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch Here's a cleaned up patch, please take a look. I ran

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12929810#action_12929810 ] Jason Rutherglen commented on LUCENE-2680: -- The problem could be that IW

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12929927#action_12929927 ] Jason Rutherglen commented on LUCENE-2680: -- Ok, TestThreadedOptimize works when

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-07 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch I placed (for now) the segment deletes directly into the

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-07 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch Everything passes, except for tests that involve IW

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-07 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12929424#action_12929424 ] Jason Rutherglen commented on LUCENE-2680: -- In DW abort (called by IW

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-07 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch Here's an uncleaned up cut with all tests passing. I

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-06 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12929229#action_12929229 ] Jason Rutherglen commented on LUCENE-2680: -- Pushing the segment infos seems to

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-06 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12929247#action_12929247 ] Jason Rutherglen commented on LUCENE-2680: -- I wasn't coalescing the merged

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-06 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12929254#action_12929254 ] Jason Rutherglen commented on LUCENE-2680: -- Putting a sync on DW block around the

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-06 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch Here's a check point patch before I re-add

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-05 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928933#action_12928933 ] Jason Rutherglen commented on LUCENE-2680: -- Sorry, spoke too soon, I made a small

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-04 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch Here's a nice little checkpoint with more tests passing.

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927943#action_12927943 ] Jason Rutherglen commented on LUCENE-2680: -- I'm redoing things a bit to take into

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927979#action_12927979 ] Jason Rutherglen commented on LUCENE-2680: -- Another use case that can be wacky is

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928075#action_12928075 ] Jason Rutherglen commented on LUCENE-2680: -- There's an issue in that we're

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928078#action_12928078 ] Jason Rutherglen commented on LUCENE-2680: -- This brings up another issue which is

[jira] Commented: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-02 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927488#action_12927488 ] Jason Rutherglen commented on LUCENE-2680: -- bq. The most recent one wins, and we

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-02 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch Here's a new patch with properly working last segment

[jira] Commented: (LUCENE-2729) Index corruption after 'read past EOF' under heavy update load and snapshot export

2010-11-01 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927031#action_12927031 ] Jason Rutherglen commented on LUCENE-2729: -- Using Solr 1.4.2 on disk full .del

[jira] Updated: (LUCENE-2680) Improve how IndexWriter flushes deletes against existing segments

2010-11-01 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2680: - Attachment: LUCENE-2680.patch The general approach is to reuse BufferedDeletes though

[jira] Commented: (LUCENE-2729) Index corruption after 'read past EOF' under heavy update load and snapshot export

2010-10-29 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12926360#action_12926360 ] Jason Rutherglen commented on LUCENE-2729: -- Post a listing of the index files

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

2010-10-19 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12922597#action_12922597 ] Jason Rutherglen commented on LUCENE-2312: -- FreqProxTermsWriterPerField writes

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-10-16 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12921784#action_12921784 ] Jason Rutherglen commented on LUCENE-2575: -- The issue with the model given is the

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

2010-10-16 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12921786#action_12921786 ] Jason Rutherglen commented on LUCENE-2312: -- We don't need to create a new spine

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

2010-10-12 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12920408#action_12920408 ] Jason Rutherglen commented on LUCENE-2312: -- An interesting question for this

[jira] Updated: (LUCENE-2575) Concurrent byte and int block implementations

2010-10-10 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2575: - Attachment: LUCENE-2575.patch As per discussion, this patch removes byte block pool

[jira] Created: (LUCENE-2693) Add delete term and query need to more precisely record the bytes used

2010-10-09 Thread Jason Rutherglen (JIRA)
Add delete term and query need to more precisely record the bytes used -- Key: LUCENE-2693 URL: https://issues.apache.org/jira/browse/LUCENE-2693 Project: Lucene - Java

[jira] Updated: (LUCENE-2693) Add delete term and query need to more precisely record the bytes used

2010-10-09 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2693: - Attachment: LUCENE-2693.patch Patch. The query value was changed to

[jira] Commented: (LUCENE-2662) BytesHash

2010-10-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12917354#action_12917354 ] Jason Rutherglen commented on LUCENE-2662: -- Simon, I'm going to get deletes

[jira] Updated: (LUCENE-2662) BytesHash

2010-10-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2662: - Affects Version/s: (was: Realtime Branch) Fix Version/s: (was: Realtime

[jira] Commented: (LUCENE-2662) BytesHash

2010-10-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12917416#action_12917416 ] Jason Rutherglen commented on LUCENE-2662: -- Lets commit this to trunk. We need

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-10-01 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916914#action_12916914 ] Jason Rutherglen commented on LUCENE-2575: -- bq. I fear a copy-on-write check

[jira] Commented: (LUCENE-2655) Get deletes working in the realtime branch

2010-10-01 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916933#action_12916933 ] Jason Rutherglen commented on LUCENE-2655: -- Are you saying we should simply make

[jira] Commented: (LUCENE-2655) Get deletes working in the realtime branch

2010-10-01 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916979#action_12916979 ] Jason Rutherglen commented on LUCENE-2655: -- {quote}when IW.deleteDocs(Term/Query)

[jira] Commented: (LUCENE-2655) Get deletes working in the realtime branch

2010-10-01 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12917046#action_12917046 ] Jason Rutherglen commented on LUCENE-2655: -- We've implied an additional change to

[jira] Commented: (LUCENE-2655) Get deletes working in the realtime branch

2010-10-01 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12917076#action_12917076 ] Jason Rutherglen commented on LUCENE-2655: -- Ok, I have been stuck/excited about

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-29 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916199#action_12916199 ] Jason Rutherglen commented on LUCENE-2575: -- bq. We'd need to increase the level 0

[jira] Commented: (LUCENE-2662) BytesHash

2010-09-29 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916355#action_12916355 ] Jason Rutherglen commented on LUCENE-2662: -- {quote}we could factor out a super

[jira] Updated: (LUCENE-2655) Get deletes working in the realtime branch

2010-09-29 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2655: - Attachment: LUCENE-2655.patch Here's a basic patch with a test case showing delete by

[jira] Commented: (LUCENE-2655) Get deletes working in the realtime branch

2010-09-29 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916366#action_12916366 ] Jason Rutherglen commented on LUCENE-2655: -- Maybe I was using the new flex API

[jira] Commented: (LUCENE-2655) Get deletes working in the realtime branch

2010-09-29 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916367#action_12916367 ] Jason Rutherglen commented on LUCENE-2655: -- I'm only seeing this test from

[jira] Commented: (LUCENE-2655) Get deletes working in the realtime branch

2010-09-29 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916370#action_12916370 ] Jason Rutherglen commented on LUCENE-2655: -- There's this one as well, which I'll

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-28 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12915797#action_12915797 ] Jason Rutherglen commented on LUCENE-2575: -- {quote}Hmm so we also copy-on-write a

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-28 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916000#action_12916000 ] Jason Rutherglen commented on LUCENE-2575: -- OK, I think there's a solution to

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-28 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916001#action_12916001 ] Jason Rutherglen commented on LUCENE-2575: -- I guess another possible solution is

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-28 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916005#action_12916005 ] Jason Rutherglen commented on LUCENE-2575: -- The last comment shows the brain is

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-27 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12915137#action_12915137 ] Jason Rutherglen commented on LUCENE-2575: -- There's a little error in thinking of

[jira] Commented: (LUCENE-2662) BytesHash

2010-09-26 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12915079#action_12915079 ] Jason Rutherglen commented on LUCENE-2662: -- Simon, the patch looks like it's

[jira] Issue Comment Edited: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-26 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12915130#action_12915130 ] Jason Rutherglen edited comment on LUCENE-2575 at 9/27/10 1:44 AM:

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-25 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914838#action_12914838 ] Jason Rutherglen commented on LUCENE-2575: -- {quote}Can you explain what's the

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-25 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914860#action_12914860 ] Jason Rutherglen commented on LUCENE-2575: -- Further thoughts on ref counting the

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-25 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914863#action_12914863 ] Jason Rutherglen commented on LUCENE-2575: -- In regards to the performance effects

[jira] Commented: (LUCENE-2662) BytesHash

2010-09-25 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914888#action_12914888 ] Jason Rutherglen commented on LUCENE-2662: -- An API change to BBP that would be

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-25 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914902#action_12914902 ] Jason Rutherglen commented on LUCENE-2575: -- The RAM buffer single-level skip list

[jira] Commented: (LUCENE-2662) BytesHash

2010-09-24 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914478#action_12914478 ] Jason Rutherglen commented on LUCENE-2662: -- BytesRefHash is now final and does

[jira] Commented: (LUCENE-2662) BytesHash

2010-09-24 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914521#action_12914521 ] Jason Rutherglen commented on LUCENE-2662: -- bq. make sure JIT doesn't play nasty

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-24 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914607#action_12914607 ] Jason Rutherglen commented on LUCENE-2575: -- The current MultiLevelSkipList*

[jira] Issue Comment Edited: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-24 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914607#action_12914607 ] Jason Rutherglen edited comment on LUCENE-2575 at 9/24/10 3:28 PM:

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-24 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914684#action_12914684 ] Jason Rutherglen commented on LUCENE-2575: -- {quote}Maybe we can not skip until

[jira] Commented: (LUCENE-2573) Tiered flushing of DWPTs by RAM with low/high water marks

2010-09-23 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12914296#action_12914296 ] Jason Rutherglen commented on LUCENE-2573: -- I was hoping something clever would

[jira] Updated: (LUCENE-2662) BytesHash

2010-09-22 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2662: - Attachment: LUCENE-2662.patch We need unit tests and a base implementation as BytesHash

[jira] Commented: (LUCENE-2662) BytesHash

2010-09-22 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913589#action_12913589 ] Jason Rutherglen commented on LUCENE-2662: -- The current hash implementation needs

[jira] Commented: (LUCENE-2662) BytesHash

2010-09-22 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913638#action_12913638 ] Jason Rutherglen commented on LUCENE-2662: -- Simon, when do you think you'll be

[jira] Commented: (LUCENE-2662) BytesHash

2010-09-22 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913651#action_12913651 ] Jason Rutherglen commented on LUCENE-2662: -- It'd be nice to get deletes working,

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-21 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913383#action_12913383 ] Jason Rutherglen commented on LUCENE-2575: -- This issue is blocked because the

[jira] Commented: (LUCENE-2312) Search on IndexWriter's RAM Buffer

2010-09-21 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913389#action_12913389 ] Jason Rutherglen commented on LUCENE-2312: -- The patches I've been submitting to

[jira] Issue Comment Edited: (LUCENE-2567) RT Terms Dictionary

2010-09-21 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913385#action_12913385 ] Jason Rutherglen edited comment on LUCENE-2567 at 9/22/10 12:34 AM:

[jira] Updated: (LUCENE-2312) Search on IndexWriter's RAM Buffer

2010-09-21 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2312: - Affects Version/s: Realtime Branch (was: 3.0.1) Search on

[jira] Commented: (LUCENE-2558) Use sequence ids for deleted docs

2010-09-21 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913400#action_12913400 ] Jason Rutherglen commented on LUCENE-2558: -- For the deleted docs sequence id

[jira] Created: (LUCENE-2662) BytesHash

2010-09-21 Thread Jason Rutherglen (JIRA)
BytesHash - Key: LUCENE-2662 URL: https://issues.apache.org/jira/browse/LUCENE-2662 Project: Lucene - Java Issue Type: Improvement Components: Index Affects Versions: Realtime Branch Reporter: Jason

[jira] Updated: (LUCENE-2662) BytesHash

2010-09-21 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2662: - Priority: Minor (was: Major) BytesHash - Key: LUCENE-2662

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-21 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12913403#action_12913403 ] Jason Rutherglen commented on LUCENE-2575: -- A further question for this issue, in

[jira] Commented: (SOLR-1301) Solr + Hadoop

2010-09-20 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12912497#action_12912497 ] Jason Rutherglen commented on SOLR-1301: Alexander, I think we'll need to use

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2010-09-19 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12912312#action_12912312 ] Jason Rutherglen commented on LUCENE-2324: -- Simon, on second thought, lets go

[jira] Created: (LUCENE-2655) Get deletes working in the realtime branch

2010-09-19 Thread Jason Rutherglen (JIRA)
Get deletes working in the realtime branch -- Key: LUCENE-2655 URL: https://issues.apache.org/jira/browse/LUCENE-2655 Project: Lucene - Java Issue Type: Improvement Components: Index

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2010-09-19 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12912313#action_12912313 ] Jason Rutherglen commented on LUCENE-2324: -- I opened an issue for the deletes

[jira] Issue Comment Edited: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2010-09-19 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12912312#action_12912312 ] Jason Rutherglen edited comment on LUCENE-2324 at 9/19/10 10:52 PM:

[jira] Commented: (LUCENE-2655) Get deletes working in the realtime branch

2010-09-19 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12912315#action_12912315 ] Jason Rutherglen commented on LUCENE-2655: -- Here's a relevant comment from

[jira] Commented: (LUCENE-2655) Get deletes working in the realtime branch

2010-09-19 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12912319#action_12912319 ] Jason Rutherglen commented on LUCENE-2655: -- {quote}Maybe we could reuse (factor

[jira] Commented: (LUCENE-2655) Get deletes working in the realtime branch

2010-09-19 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12912339#action_12912339 ] Jason Rutherglen commented on LUCENE-2655: -- A couple more things... The

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2010-09-18 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12911144#action_12911144 ] Jason Rutherglen commented on LUCENE-2324: -- Simon, I think the BytesHash being

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-16 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910201#action_12910201 ] Jason Rutherglen commented on LUCENE-2575: -- bq. we know what size (level + 1,

[jira] Commented: (LUCENE-2324) Per thread DocumentsWriters that write their own private segments

2010-09-16 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12910268#action_12910268 ] Jason Rutherglen commented on LUCENE-2324: -- bq. I think the sync'd flush is a big

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-15 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12909771#action_12909771 ] Jason Rutherglen commented on LUCENE-2575: -- Because of the way byte slices work,

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-15 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12909839#action_12909839 ] Jason Rutherglen commented on LUCENE-2575: -- Is there a way to know the level of a

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-15 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12909852#action_12909852 ] Jason Rutherglen commented on LUCENE-2575: -- In the following line of

[jira] Updated: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-14 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2575: - Attachment: LUCENE-2575.patch Term frequency is recorded and returned. There are

[jira] Updated: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-14 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2575: - Attachment: LUCENE-2575.patch Added a unit test for payloads, term vectors, and doc

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-14 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12909580#action_12909580 ] Jason Rutherglen commented on LUCENE-2575: -- For the posting skip list we need to

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-13 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12908849#action_12908849 ] Jason Rutherglen commented on LUCENE-2575: -- One thing I noticed, correct me if

[jira] Updated: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-11 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2575: - Attachment: LUCENE-2575.patch Here's a start at concurrency, the terms dictionary, and

[jira] Updated: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-11 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2575: - Attachment: LUCENE-2575.patch This includes a basic implementation of the sorted term

[jira] Commented: (LUCENE-2575) Concurrent byte and int block implementations

2010-09-08 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12907493#action_12907493 ] Jason Rutherglen commented on LUCENE-2575: -- I'm finally understanding the slice

[jira] Commented: (LUCENE-2573) Tiered flushing of DWPTs by RAM with low/high water marks

2010-09-07 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12906798#action_12906798 ] Jason Rutherglen commented on LUCENE-2573: -- bq. shouldn't tiered flushing take

[jira] Commented: (LUCENE-2573) Tiered flushing of DWPTs by RAM with low/high water marks

2010-09-07 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12906801#action_12906801 ] Jason Rutherglen commented on LUCENE-2573: -- bq. We can modify MockRAMDir to

[jira] Updated: (LUCENE-2573) Tiered flushing of DWPTs by RAM with low/high water marks

2010-09-07 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2573: - Attachment: LUCENE-2573.patch * perDocAllocator is removed from

[jira] Commented: (LUCENE-2573) Tiered flushing of DWPTs by RAM with low/high water marks

2010-09-07 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12906918#action_12906918 ] Jason Rutherglen commented on LUCENE-2573: -- The last patch also only flushes a

[jira] Updated: (LUCENE-2573) Tiered flushing of DWPTs by RAM with low/high water marks

2010-09-07 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Rutherglen updated LUCENE-2573: - Attachment: LUCENE-2573.patch There was a small bug in the choice of the max DWPT, in

<    1   2   3   4   5   6   7   8   9   10   >