Samuel Guo wrote:
Hi all,
I think there is a protocol.file plugin that nutch can use to fetch the
local filesystem's files to index. If there is also a protocol plugin like
protocal.hdfs that can be use to index the files in the HDFS, I think it may
be helpful. But it seems no such plugin in nutch or maybe I lose it when I
looking into the plugin dir. Can anyone help me with this question? Thanks a
lot :)
There is no such plugin yet, but it would be quite simple to write -
basically copy the protocol-file and use the Hadoop FileSystem methods
instead of the ones from java.io.File.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
