[jira] Commented: (LUCENE-1039) Bayesian classifiers using Lucene as data store

2009-03-29 Thread Vaijanath N. Rao (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693643#action_12693643 ] Vaijanath N. Rao commented on LUCENE-1039: -- Hi Karl, Can you tell me how to use

Re: Possible IndexInput optimization

2009-03-29 Thread Earwin Burrfoot
>> In my case I have to switch to MMap/Buffers, Java behaves ugly with >> 8Gb heaps. > Do you mean that because garbage collection does not perform well > on these larger heaps, one should avoid to create arrays to have heaps > of that size, and rather use (direct) MMap/Buffers? Yes, exactly. Keepi

[jira] Updated: (LUCENE-1579) Cloned SegmentReaders fail to share FieldCache entries

2009-03-29 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-1579: --- Attachment: LUCENE-1579.patch New patch, even simpler. > Cloned SegmentReaders fail

[jira] Commented: (LUCENE-1581) LowerCaseFilter should be able to be configured to use a specific locale.

2009-03-29 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693591#action_12693591 ] Robert Muir commented on LUCENE-1581: - some comments I have on this topic: the proble

Re: LockObtainFailedException exception

2009-03-29 Thread Michael McCandless
Super, thanks for bringing closure! Mike On Sun, Mar 29, 2009 at 11:58 AM, Ketan Deshpande wrote: > Hi Mike, > >   Thanks for the response. I did a code check but this was a random error, > which indicated towards something to do with the environment. Finally, I did > figure out the problem - lo

[jira] Commented: (LUCENE-1581) LowerCaseFilter should be able to be configured to use a specific locale.

2009-03-29 Thread DM Smith (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693579#action_12693579 ] DM Smith commented on LUCENE-1581: -- bq.Why do this? Lucene has a bias toward English text

Re: LockObtainFailedException exception

2009-03-29 Thread Ketan Deshpande
Hi Mike,     Thanks for the response. I did a code check but this was a random error, which indicated towards something to do with the environment. Finally, I did figure out the problem - low disk space. Though there was around 1 GB of free space on the server, it was not sufficient when we had

Re: Possible IndexInput optimization

2009-03-29 Thread Paul Elschot
On Sunday 29 March 2009 13:47:59 Earwin Burrfoot wrote: > > Earwin, > > I did not experiment lately, but I'd like to add a general compressed > > integer array to the basic types in an index, that would be compressed > > on writing and decompressed on reading. > > A first attempt is at LUCENE-1410,

[jira] Commented: (LUCENE-1581) LowerCaseFilter should be able to be configured to use a specific locale.

2009-03-29 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693568#action_12693568 ] Shai Erera commented on LUCENE-1581: bq. What I'd like to see is that lucene has a plu

[jira] Updated: (LUCENE-1516) Integrate IndexReader with IndexWriter

2009-03-29 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-1516: --- Attachment: ssd2.png OK using the last patch, I ran another near real-time test, us

[jira] Commented: (LUCENE-1581) LowerCaseFilter should be able to be configured to use a specific locale.

2009-03-29 Thread Digy (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693553#action_12693553 ] Digy commented on LUCENE-1581: -- Although, it is not directly related to this issue, It is goo

[jira] Commented: (LUCENE-1581) LowerCaseFilter should be able to be configured to use a specific locale.

2009-03-29 Thread DM Smith (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693545#action_12693545 ] DM Smith commented on LUCENE-1581: -- This a bit larger of a problem. It also pertains to u

Re: Possible IndexInput optimization

2009-03-29 Thread Earwin Burrfoot
> Earwin, > I did not experiment lately, but I'd like to add a general compressed > integer array to the basic types in an index, that would be compressed > on writing and decompressed on reading. > A first attempt is at LUCENE-1410, and one of the choices I had there > was whether or not to use NI

Re: Possible IndexInput optimization

2009-03-29 Thread Earwin Burrfoot
> A while ago I tried overriding the read* methods in BufferedIndexInput like > this: > > I'm still surprised there was no performance improvement at all. Maybe > something was wrong with my test and I should try it again... For BufferedIndexInput improvement should be

[jira] Commented: (LUCENE-1581) LowerCaseFilter should be able to be configured to use a specific locale.

2009-03-29 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693540#action_12693540 ] Shai Erera commented on LUCENE-1581: >From the javadocs >(http://java.sun.com/j2se/1.

Re: Possible IndexInput optimization

2009-03-29 Thread Michael Busch
On 3/29/09 12:43 AM, Earwin Burrfoot wrote: There are three cases when we can override readNNN methods and provide implementations with zero or minimum method invocations - RAMDirectory, MMapDirectory and BufferedIndexInput for FSDirectory/CompoundFileReader. Anybody tried this? A while ag

[jira] Commented: (LUCENE-1575) Refactoring Lucene collectors (HitCollector and extensions)

2009-03-29 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693533#action_12693533 ] Michael McCandless commented on LUCENE-1575: bq. May I change it to BooleanCol

[jira] Commented: (LUCENE-1581) LowerCaseFilter should be able to be configured to use a specific locale.

2009-03-29 Thread Digy (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693528#action_12693528 ] Digy commented on LUCENE-1581: -- I believe also that Character.toLowerCase in Java works ok, B

Re: Possible IndexInput optimization

2009-03-29 Thread Paul Elschot
Earwin, I did not experiment lately, but I'd like to add a general compressed integer array to the basic types in an index, that would be compressed on writing and decompressed on reading. A first attempt is at LUCENE-1410, and one of the choices I had there was whether or not to use NIO buffer m