Re: improve how IndexWriter uses RAM to buffer added documents

2007-04-06 Thread Michael McCandless
"Marvin Humphrey" <[EMAIL PROTECTED]> wrote: > > On Apr 5, 2007, at 5:26 PM, Michael McCandless wrote: > > >> What we need to do is cut down on decompression and conflict > >> resolution costs when reading from one segment to another. KS has > >> solved this problem for stored fields. Field defs

Re: TestIndexWriter.testAddIndexOnDiskFull failed

2007-04-06 Thread Paul Elschot
On Thursday 05 April 2007 20:11, Michael McCandless wrote: > > "Paul Elschot" <[EMAIL PROTECTED]> wrote: > > At revision 525912: ... > > I just got a fresh checkout and the test is passing. That's one scary output > from the test (input index disk usage). It seems like RAMDirectory.fileLength

Re: Caching in QueryFilter - why?

2007-04-06 Thread Peter Keegan
this seems like a potentially big surprise for people when upgrading ... old code will continue to work fine without warning, just get a lot less efficient. I agree. This would certainly be a big surprise to anyone not following this forum closely (like me - I just happened to stumble upon this

[jira] Updated: (LUCENE-855) MemoryCachedRangeFilter to boost performance of Range queries

2007-04-06 Thread Andy Liu (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Liu updated LUCENE-855: Attachment: MemoryCachedRangeFilter_1.4.patch Here's a patch that should compile in Java 1.4 . It includes

IndexReader.deleteDocuement(); How to use it with our code??

2007-04-06 Thread Ratnesh,V2Solutions India
HI, I have written a plugin which finds out "object" tags url and store it in the index with "objects" fields. I am intrested in getting only those url's which has "object" tag but instead I get all the urls to be indexed. So what I want is to delete some unwanted urls which don't have "object" t

[jira] Commented: (LUCENE-708) Setup nightly build website links and docs

2007-04-06 Thread Tim Patton (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487252 ] Tim Patton commented on LUCENE-708: --- The latest version of the nigthly build #45 (4/6/2007) contains references to

Re: Lucene nightly build failure

2007-04-06 Thread Grant Ingersoll
OK, I have Hudson access, and I notice that Doug does as well, so we have at least three people capable of administering. Anyone else w/ zones access can see the wiki for instructions on how to access. It is pretty straightforward. We are going to setup Hudson to run the nightly.sh so tha

[jira] Commented: (LUCENE-708) Setup nightly build website links and docs

2007-04-06 Thread Grant Ingersoll (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487284 ] Grant Ingersoll commented on LUCENE-708: Thanks, Tim. We are looking into it. We are converting to use Hu

Re: Lucene nightly build failure

2007-04-06 Thread Chris Hostetter
: We are going to setup Hudson to run the nightly.sh so that the : website and javadocs are pushed to people.a.o. I think this makes : more sense, b/c if Hudson fails then critical things like the website : and javadocs are down, whereas I think p.a.o seems to be better in +1 for the stability of

[jira] Commented: (LUCENE-622) Provide More of Lucene For Maven

2007-04-06 Thread Larry Hamel (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487309 ] Larry Hamel commented on LUCENE-622: Please update maven repo for 2.1 > Provide More of Lucene For Maven > -

Re: [jira] Resolved: (LUCENE-796) Change Visibility of fields[] in MultiFieldQueryParser

2007-04-06 Thread Chris Hostetter
: I'm not sure if this applies to this issue, but ISTM that a "private : unless you bug the devs" approach to variable scoping is a little odd. : A few unecessary "private"s sprinkled through the code can really : wreck havoc on effects to extend functionality cleanly. This has the trade off is

[jira] Reopened: (LUCENE-636) [PATCH] Differently configured Lucene 'instances' in same JVM

2007-04-06 Thread Hoss Man (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hoss Man reopened LUCENE-636: - I think Ken is right, while most of the uses are for debugging or in legacy methods that have newer ways cal

[jira] Updated: (LUCENE-855) MemoryCachedRangeFilter to boost performance of Range queries

2007-04-06 Thread Matt Ericson (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Ericson updated LUCENE-855: Attachment: FieldCacheRangeFilter.patch Here is my Version of a FieldCacheRangeFilter I used diffe

linking the API docs

2007-04-06 Thread Daniel Naber
Hi, we have a short but (I think) useful snippet of example code in our API docs: http://lucene.zones.apache.org:8080/hudson/job/Lucene-Nightly/javadoc/overview-summary.html#overview_description We also have the "Getting started" section on the web site, which only refers to the demo and doesn

Re: linking the API docs

2007-04-06 Thread Grant Ingersoll
I think you can put in the link, just use relative link like in the site.xml. -Grant On Apr 6, 2007, at 5:00 PM, Daniel Naber wrote: Hi, we have a short but (I think) useful snippet of example code in our API docs: http://lucene.zones.apache.org:8080/hudson/job/Lucene-Nightly/ javadoc/

Re: linking the API docs

2007-04-06 Thread Chris Hostetter
: : I think you can put in the link, just use relative link like in the : site.xml. using a relative link is *key* ... it ensures not only that the static files build by the nightly build work, but also that the docs distributed with each release contain good local pointers. -Hoss --

optimize() method call

2007-04-06 Thread Grant Ingersoll
I was looking at the javadocs for the optimize() call on IndexWriter which contain a great amount of detail about what happens, but very little guidance on when. I would like to add more on when. I generally do optimize after I finish my indexing, which is pretty straightforward to determ

Large scale sorting

2007-04-06 Thread Paul Smith
A discussion on the user list brought my mind to the longer term scalability issues of Lucene. Lucene is inherently memory efficient, except for sorting, when the inverted index nature of the index works against the required nature of having a value for each object to sort against. I'm h

[jira] Commented: (LUCENE-855) MemoryCachedRangeFilter to boost performance of Range queries

2007-04-06 Thread Andy Liu (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487378 ] Andy Liu commented on LUCENE-855: - Hey Matt, The way you implemented FieldCacheRangeFilter is very simple and clever

[jira] Commented: (LUCENE-855) MemoryCachedRangeFilter to boost performance of Range queries

2007-04-06 Thread Matt Ericson (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487380 ] Matt Ericson commented on LUCENE-855: - I will be happy to fix #2 or a to try to fix #2 The test had the real wo