[ http://issues.apache.org/jira/browse/NUTCH-5?page=history ]
Doug Cutting resolved NUTCH-5:
------------------------------
Resolution: Fixed
I have applied this patch.
Thanks, Andy!
> Hit limiter off-by-one bug
> --------------------------
>
> Key: NUTCH-5
> URL: http://issues.apache.org/jira/browse/NUTCH-5
> Project: Nutch
> Type: Bug
> Components: searcher
> Reporter: Andy Liu
> Priority: Minor
> Attachments: fix-hitlimiting.patch
>
> When re-searching for more raw hits, the first result of the next site is
> skipped.
> From NutchBean.java
> *snip*
> // get the next raw hit
> if (rawHitNum >= hits.getLength()) {
> // optimize query by prohibiting more matches on some
> excluded sites
> Query optQuery = (Query) query.clone();
> for (int i = 0; i < excludedSites.size(); i++) {
> if (i == MAX_PROHIBITED_TERMS) {
> break;
> }
> optQuery.addProhibitedTerm(((String)
> excludedSites.get(i)),
> IndexSearcher.HIT_LIMIT_FIELD);
> }
> numHitsRaw = (int) (numHitsRaw * RAW_HITS_FACTOR);
> LOG.info("re-searching for " + numHitsRaw +
> " raw hits, query: " + optQuery);
> hits = searcher.search(optQuery, numHitsRaw);
> LOG.info("found " + hits.getTotal() + " raw hits");
> rawHitNum = 0;
> continue;
> }
> *snip*
> rawHitNum is reset to 0, but the for loop increments it by one and skips the
> next result.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
If you want more information on JIRA, or have a bug to report see:
http://www.atlassian.com/software/jira
-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
