Make Nutch crawling parent directories for file protocol configurable
---------------------------------------------------------------------
Key: NUTCH-407
URL: http://issues.apache.org/jira/browse/NUTCH-407
Project: Nutch
Issue Type: Improvement
Affects Versions: 0.8
Reporter: Thorsten Scherler
http://www.mail-archive.com/nutch-user@lucene.apache.org/msg06698.html
I am looking into fixing some very weird behavior of the file protocol.
I am using 0.8.
Researching this topic I found
http://www.mail-archive.com/nutch-user@lucene.apache.org/msg06536.html
and
http://www.folge2.de/tp/search/1/crawling-the-local-filesystem-with-nutch
I am on Ubuntu but I have the same problem that nutch is going down the
tree (including parents) and not up (including children from the root
url).
Further I would vote to make the fetch-parents optional and defined per
a property whether I would like this not very intuitive "feature".
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-developers mailing list
Nutch-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-developers
