Re: Running out of disk space during segment merger

...@snooth.com] Sent: Saturday, 27 March 2010 2:21 AM To: nutch-user@lucene.apache.org Subject: Re: Running out of disk space during segment merger Thanks a lot for your reply, Arkadi. It's good to know that this is indeed a known problem. With the current version, is there anything more one can do other

RE: Running out of disk space during segment merger

Hi Yves, I am glad it helped. Wish you success. Regards, Arkadi -Original Message- From: Yves Petinot [mailto:y...@snooth.com] Sent: Saturday, 10 April 2010 12:56 AM To: nutch-user@lucene.apache.org Subject: Re: Running out of disk space during segment merger Arkadi, thanks

Re: Running out of disk space during segment merger

Thanks a lot for your reply, Arkadi. It's good to know that this is indeed a known problem. With the current version, is there anything more one can do other than throwing a huge amount of temp disk space at each node ? Based on my experience and given a replication factor of N, would a rule

RE: Running out of disk space during segment merger

- From: Yves Petinot [mailto:y...@snooth.com] Sent: Saturday, 27 March 2010 2:21 AM To: nutch-user@lucene.apache.org Subject: Re: Running out of disk space during segment merger Thanks a lot for your reply, Arkadi. It's good to know that this is indeed a known problem. With the current version

RE: Running out of disk space during segment merger

Hi Yves, Yes, what you got is a normal result. This issue is discussed every few months on this list. To my mind, the segment merger is too general. It assumes that the segments are at arbitrary stages of completion and works on this assumption. But, this is not a common case at all. Mostly,