[
https://issues.apache.org/jira/browse/NUTCH-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13025823#comment-13025823
]
Gabriele Kahlout commented on NUTCH-990:
----------------------------------------
I ran it on a fresh crawl (and index). I've tried it with a 'good' html page
and 'bad' one and the bad doesn't get into the index while the good does.
> protocol-httpclient fails with actually plain/text pages
> --------------------------------------------------------
>
> Key: NUTCH-990
> URL: https://issues.apache.org/jira/browse/NUTCH-990
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Reporter: Gabriele Kahlout
> Priority: Minor
> Fix For: 1.3
>
>
> Using protocol-http html pages without <html> tag are correctly fetched,
> parsed and indexed. All it takes (I now discover) is to use
> protocol-httpclient for the page to disappear from the index. But the page is
> fetched.
> $ cat page.html
> abc
> Those small files are useful for quick testing.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
