[
https://issues.apache.org/jira/browse/NUTCH-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabriele Kahlout updated NUTCH-990:
-----------------------------------
Description:
Using protocol-http with a few words html pages works fine. But with
protocol-httpclient the same pages disappear from the index, although they are
still fetched.
Those small files are useful for quick testing.
was:
Using protocol-http html pages without <html> tag are correctly fetched, parsed
and indexed. All it takes (I now discover) is to use protocol-httpclient for
the page to disappear from the index. But the page is fetched.
$ cat page.html
abc
Those small files are useful for quick testing.
Summary: protocol-httpclient fails with short pages (was:
protocol-httpclient fails with actually plain/text pages)
A test page:
<!DOCTYPE html>
<html>
<head>
<title></title>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
artificial rucksack
</body>
</html>
> protocol-httpclient fails with short pages
> ------------------------------------------
>
> Key: NUTCH-990
> URL: https://issues.apache.org/jira/browse/NUTCH-990
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Reporter: Gabriele Kahlout
> Priority: Minor
> Fix For: 1.3
>
> Attachments: hadoop.log
>
>
> Using protocol-http with a few words html pages works fine. But with
> protocol-httpclient the same pages disappear from the index, although they
> are still fetched.
> Those small files are useful for quick testing.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
