[
https://issues.apache.org/jira/browse/NUTCH-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13025820#comment-13025820
]
Markus Jelsma commented on NUTCH-990:
-------------------------------------
What does the log say? I tried my home_dir with httpclient but it immediately
failed to fetch my Apache generated directory index (which is a HTML file):
fetch of http://localhost/~markus/ failed with: java.io.IOException:
unzipBestEffort returned null
Did you try httpclient with a clean crawl? Testing the behavior if different
plugins is usually easier with clean crawldb's.
> protocol-httpclient fails with actually plain/text pages
> --------------------------------------------------------
>
> Key: NUTCH-990
> URL: https://issues.apache.org/jira/browse/NUTCH-990
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Reporter: Gabriele Kahlout
> Priority: Minor
> Fix For: 1.3
>
>
> Using protocol-http html pages without <html> tag are correctly fetched,
> parsed and indexed. All it takes (I now discover) is to use
> protocol-httpclient for the page to disappear from the index. But the page is
> fetched.
> $ cat page.html
> abc
> Those small files are useful for quick testing.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
