Re: pruning package- pruneAllPositions

2012-06-04 Thread Zeynep P.
Hi, Thanks for your fix. I used it but I think there is something wrong with the fix!!? because I am using LATimes collection and with epsilon = 0.1 and k =10 I got 97% pruned index. It means 3% of index left unchanged after pruning. In the the original paper, "Static index pruning for IR systems

Re: pruning package- pruneAllPositions

2012-05-07 Thread jake dsouza
Hi Zeynep, I was facing the same issue in CarmelUniformTermPruningPolicy in package org.apache.lucene.index.pruning . I think the issue is in the while loop condition in following peice of code *while ((docsPos < (docs.length - 1))* * && termPositions.doc() > docs[docsPos].doc) {* * docsPos++;*

Re: pruning package- pruneAllPositions

2012-05-07 Thread Zeynep P.
Thanks for the link. I reviewed it. Here are more details about the exception: I used contrib/benchmark/conf/wikipedia.alg to index wikipedia dump with MAddDocs: 20. I wanted to index only a specific period of time so I added an if statement in doLogic of AddDocTask class. I tried to prune t

Re: pruning package- pruneAllPositions

2012-05-02 Thread Erick Erickson
Not unless you provide a lot more context, there's nothing to go on here! You might review: http://wiki.apache.org/solr/UsingMailingLists Best Erick On Wed, May 2, 2012 at 6:11 AM, Zeynep P. wrote: > Hi, > > In the pruning package, pruneAllPositions throws an exception. In the code > it is comm