Re: Two Nutch parallel crawl with two conf folder.

2010-03-09 Thread eks dev
sorry for the noise.. I've mixed up Emails - Original Message > From: eks dev > To: nutch-user@lucene.apache.org > Sent: Tue, 9 March, 2010 18:07:47 > Subject: Re: Two Nutch parallel crawl with two conf folder. > > coool answer > > > > -

Re: Two Nutch parallel crawl with two conf folder.

2010-03-09 Thread eks dev
coool answer - Original Message > From: MilleBii > To: nutch-user@lucene.apache.org > Sent: Tue, 9 March, 2010 8:35:42 > Subject: Re: Two Nutch parallel crawl with two conf folder. > > Yes it should work, I personnaly run some tests crawl on the same > hardw

Re: Two Nutch parallel crawl with two conf folder.

2010-03-09 Thread Gora Mohanty
On Tue, 9 Mar 2010 14:36:33 +0100 MilleBii wrote: > Never tried... Also you may want to check $NUTCH_HOME variable > which should be different for each instance, otherwise it will > only use one of the two conf dir. [...] Had meant to reply to the original poster, but had forgotten. We have inde

Re: Two Nutch parallel crawl with two conf folder.

2010-03-09 Thread MilleBii
want to share my hardware resource. >> >> I tried with two nutch setup , but somehow second instance overriding the >> first one's configuration. >> >> >> Any pointers ????? >> >> Thanks >> -Pravin >> >> >> -Original Messag

RE: Two Nutch parallel crawl with two conf folder.

2010-03-09 Thread Pravin Karne
: Tuesday, March 09, 2010 1:06 PM To: nutch-user@lucene.apache.org Subject: Re: Two Nutch parallel crawl with two conf folder. Yes it should work, I personnaly run some tests crawl on the same hardware, even on the same nutch directory thus I share the conf directory. But If you don't want that I

Re: Two Nutch parallel crawl with two conf folder.

2010-03-08 Thread MilleBii
; Thanks > -Pravin > > > -Original Message- > From: MilleBii [mailto:mille...@gmail.com] > Sent: Monday, March 08, 2010 8:02 PM > To: nutch-user@lucene.apache.org > Subject: Re: Two Nutch parallel crawl with two conf folder. > > How parallel is parallel in your c

RE: Two Nutch parallel crawl with two conf folder.

2010-03-08 Thread Pravin Karne
-user@lucene.apache.org Subject: Re: Two Nutch parallel crawl with two conf folder. How parallel is parallel in your case ? Don't forget Hadoop in distributed mode will serialize your jobs anyhow. For the rest why don't you create two Nutch directories and run things totally independently 2010/3/

Re: Two Nutch parallel crawl with two conf folder.

2010-03-08 Thread MilleBii
How parallel is parallel in your case ? Don't forget Hadoop in distributed mode will serialize your jobs anyhow. For the rest why don't you create two Nutch directories and run things totally independently 2010/3/8, Pravin Karne : > Hi guys any pointer on following. > Your help will highly appre

RE: Two Nutch parallel crawl with two conf folder.

2010-03-08 Thread Pravin Karne
Hi guys any pointer on following. Your help will highly appreciated . Thanks -Pravin -Original Message- From: Pravin Karne Sent: Friday, March 05, 2010 12:57 PM To: nutch-user@lucene.apache.org Subject: Two Nutch parallel crawl with two conf folder. Hi, I want to do two Nutch parallel c