Doug Cutting wrote:
Gal Nitzan wrote:
Is it at all necessary to merge segments located in the ndfs and if
it is, How?
Segment merging is not yet implemented in the mapred branch. Whether
it will be required is to be seen.
Doug
.
Thanks Doug.
If I understand correctly, having one segment or a hundred is not important?
What happens when a page is fetched a second time? is there something to
deduplicate it?
Regards,
Gal
-------------------------------------------------------
This SF.Net email is sponsored by:
Power Architecture Resource Center: Free content, downloads, discussions,
and more. http://solutions.newsforge.com/ibmarch.tmpl
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
