I tried setting hadoop.tmp.dir to /cygdrive/d/tmp and it created
D:\cygdrive\d\tmp\mapred\temp\inject-temp-1365510909\_reduce_n7v9vq.
The same error occurred:-
2008-02-15 10:19:22,833 WARN mapred.LocalJobRunner - job_local_1
java.io.IOException: Target
I can confirm this error as I just tried running the last revision of
Nutch, rev-620818 on Debian as well as Cygwin on Windows.
It works fine on Debian but fails on Cygwin with this error:-
2008-02-14 19:49:47,756 WARN regex.RegexURLNormalizer - can\'t find
rules for scope \'inject\', using
I think what might be occurring is a file path issue with hadoop. I
have seen it in the past. Can you try on windows using the cygdrive
path and see if that works? For below it would be /cygdrive/D/tmp/ ...
Dennis
Susam Pal wrote:
I can confirm this error as I just tried running the last
What I did try was setting hadoop.tmp.dir to /opt/tmp. I found the
behavior strange. I had an /opt/tmp directory in my Cygwin
installation (Absolute Windows path: D:\Cygwin\opt\tmp) and I was
expecting Hadoop to use it. However, it created a new D:\opt\tmp and
wrote the temp files there. Of course
DS jha wrote:
Hi -
Looks like latest trunk version of nutch is failing with the following
exception when trying to perform inject operation:
java.io.IOException: Target
file:/tmp/hadoop-user/mapred/temp/inject-temp-1280136828/_reduce_dv90x0/part-0
already exists
Is this really the latest
Yeah - it is using hadoop v 0.15.3 jar file - strange!
Thanks
Jha
On Feb 7, 2008 8:11 AM, Andrzej Bialecki [EMAIL PROTECTED] wrote:
DS jha wrote:
Hi -
Looks like latest trunk version of nutch is failing with the following
exception when trying to perform inject operation:
Would need more info on your configuration. Local or DFS,
hadoop-site.xml changes.
Dennis
DS jha wrote:
I tried setting it to false but it was still throwing the same error.
Looks like when I am using older version of hadoop (0.14.4) it is working fine.
Thanks
On Feb 7, 2008 10:37 AM,
I tried setting it to false but it was still throwing the same error.
Looks like when I am using older version of hadoop (0.14.4) it is working fine.
Thanks
On Feb 7, 2008 10:37 AM, Dennis Kubes [EMAIL PROTECTED] wrote:
Do you have speculative execution turned on. If so turn it off.
DS jha wrote:
Yeah - it is using hadoop v 0.15.3 jar file - strange!
Thanks
Jha
On Feb 7, 2008 8:11 AM, Andrzej Bialecki [EMAIL PROTECTED] wrote:
DS jha wrote:
Hi -
Looks like latest trunk version of nutch is failing with the following
exception when trying to perform inject operation:
This is running on Windows/Cygwin, with username 'user' - and it is
using default hadoop-site.xml
Thanks,
Jha
On Feb 7, 2008 10:03 AM, Andrzej Bialecki [EMAIL PROTECTED] wrote:
DS jha wrote:
Yeah - it is using hadoop v 0.15.3 jar file - strange!
Thanks
Jha
On Feb 7, 2008 8:11
Do you have speculative execution turned on. If so turn it off.
Dennis
DS jha wrote:
This is running on Windows/Cygwin, with username 'user' - and it is
using default hadoop-site.xml
Thanks,
Jha
On Feb 7, 2008 10:03 AM, Andrzej Bialecki [EMAIL PROTECTED] wrote:
DS jha wrote:
Yeah - it is
11 matches
Mail list logo
