[
https://issues.apache.org/jira/browse/NUTCH-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183660#comment-14183660
]
Mengying Wang commented on NUTCH-1483:
--------------------------------------
Dear Sebastian,
Sorry for the previous long comment. I have edited it to make it shorter.
Sorry again.
Below is the parsecheck log, it seems everything is ok, right?
$ ./nutch parsechecker
"file:/Users/AngelaWang/Documents/programs/oodt/cas-curator/staging/products/xml/monitor.xml"
fetching:
file:///Users/AngelaWang/Documents/programs/oodt/cas-curator/staging/products/xml/monitor.xml
parsing:
file:///Users/AngelaWang/Documents/programs/oodt/cas-curator/staging/products/xml/monitor.xml
contentType: application/xml
signature: 9661ebf88a280f5f11edc9d64d2ac450
Couldn't pass score, url
file:///Users/AngelaWang/Documents/programs/oodt/cas-curator/staging/products/xml/monitor.xml
(java.lang.NullPointerException)
---------
Url
---------------
file:/Users/AngelaWang/Documents/programs/oodt/cas-curator-0.6/staging/products/xml/monitor.xml
---------
ParseData
---------
Version: 5
Status: success(1,0)
Title:
Outlinks: 0
Content Metadata: Content-Length=1418 nutch.crawl.score=0.0
Last-Modified=Fri, 26 Sep 2014 17:55:25 GMT Content-Type=application/xml
Parse Metadata: Content-Type=application/xml
Best,
Mengying (Angela) Wang
On Fri, Oct 24, 2014 at 1:06 PM, Sebastian Nagel (JIRA) <[email protected]>
> Can't crawl filesystem with protocol-file plugin
> ------------------------------------------------
>
> Key: NUTCH-1483
> URL: https://issues.apache.org/jira/browse/NUTCH-1483
> Project: Nutch
> Issue Type: Bug
> Components: protocol
> Affects Versions: 1.6, 2.1
> Environment: OpenSUSE 12.1, OpenJDK 1.6.0, HBase 0.90.4
> Reporter: Rogério Pereira Araújo
> Priority: Critical
> Fix For: 2.3, 1.10
>
> Attachments: TestProtocolFileUrlUri.java
>
>
> I tried to follow the same steps described in this wiki page:
> http://wiki.apache.org/nutch/IntranetDocumentSearch
> I made all required changes on regex-urlfilter.txt and added the following
> entry in my seed file:
> file:///home/rogerio/Documents/
> The permissions are ok, I'm running nutch with the same user as folder owner,
> so nutch has all the required permissions, unfortunately I'm getting the
> following error:
> org.apache.nutch.protocol.file.FileError: File Error: 404
> at
> org.apache.nutch.protocol.file.File.getProtocolOutput(File.java:105)
> at
> org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:514)
> fetch of file://home/rogerio/Documents/ failed with:
> org.apache.nutch.protocol.file.FileError: File Error: 404
> Why the logs are showing file://home/rogerio/Documents/ instead of
> file:///home/rogerio/Documents/ ???
> Note: The regex-urlfilter entry only works as expected if I add the entry
> +^file://home/rogerio/Documents/ instead of +^file:///home/rogerio/Documents/
> as wiki says.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
