Hi,
I am using Nutch 1.0 with 10 node cluster.
I have crawled 1000 sites with 10 depth.
I got following cluster summary
5538 files and directories, 4556 blocks = 10094 total. Heap Size is 50 MB /
888.94 MB (5%)
Configured Capacity : 140 TB
DFS Used :
Hi,
I am using Nutch 1.0 with 10 node cluster.
I have crawled 1000 sites with 10 depth.
I got following cluster summary
5538 files and directories, 4556 blocks = 10094 total. Heap Size is 50 MB /
888.94 MB (5%)
Configured Capacity : 140 TB
DFS Used :