ite) 5 depth.
> When we came 4th segment parse it gave java.lang.OutOfMemoryError:
> Requested array size exceeds VM limit error each machine.. Our segment
> size
> crawled/segments/200710021632393472754178
> i try several map reduce configurations nothing change.. (400-50 ; 30
>
>
> Uygar BAYAR wrote:
>
>>hi
>> we have 4 machine cluster. (dual core CPU 3.20GHz 2GB RAM 400GB disk).We
>>use nutch 0.9 and hadoop 0.13.1. We try to crawl web (60K site) 5 depth.
>>When we came 4th segment parse it gave java.lang.OutOfMemoryError:
Uygar BAYAR wrote:
hi
we have 4 machine cluster. (dual core CPU 3.20GHz 2GB RAM 400GB disk).We
use nutch 0.9 and hadoop 0.13.1. We try to crawl web (60K site) 5 depth.
When we came 4th segment parse it gave java.lang.OutOfMemoryError:
Requested array size exceeds VM limit error each machine
hi
we have 4 machine cluster. (dual core CPU 3.20GHz 2GB RAM 400GB disk).We
use nutch 0.9 and hadoop 0.13.1. We try to crawl web (60K site) 5 depth.
When we came 4th segment parse it gave java.lang.OutOfMemoryError:
Requested array size exceeds VM limit error each machine.. Our segment size
