Merging issues!

2009-10-07 Thread tittutomen
I've tried to merge small indexes to existing index. what I've observed is after merging the Index size is decreasing! I started with a Index having 85K documents...then I merge 5K docs each...after 3 cycles instead of it becoming 100K, strangly it has become an index having 80K documents only.

Re: Targeting Specific Links

2009-10-07 Thread Andrzej Bialecki
Eric Osgood wrote: Andrzej, How would I check for a flag during fetch? You would check for a flag during generation - please check ScoringFilter.generatorSortValue(), that's where you can check for a flag and set the sort value to Float.MIN_VALUE - this way the link will never be selected

ApacheCon US

2009-10-07 Thread Grant Ingersoll
Just a friendly reminder to all about Lucene ecosystem events at ApacheCon US this year. We have two days of talks on pretty much every project under Lucene (see http://lucene.apache.org/#14+August+2009+-+Lucene+at+US+ApacheCon ) plus a meetup and a two day training on Lucene and a 1 day

Re: mapred.ReduceTask - java.io.FileNotFoundException

2009-10-07 Thread bhavin pandya
Hi, I don't know exact cause of exception but it is resolved. Earlier I have done some changes in IP settings but still server was using old configuration. I restart the service and problem is resolved. Thanks. Bhavin On Tue, Oct 6, 2009 at 4:48 PM, tittutomen subasmahapa...@gmail.com wrote:

Re: indexing just certain content

2009-10-07 Thread BELLINI ADAM
in this class the BasicIndexingFilter.java, I think before adding the contenent to the document i could parse it again to filter certain div tags ?? text = parse.getText(); // i have to parse and filter the text here before adding it to the docuement new_Filtred_text =