The objective is to test plugins and the environment is Windows.

However, nutch doesn't seem to work with this plain command line,

Why is it thinking distributed mode ?


D:\SEMANT~1\CRAWL_~1>*java -Xmx1000M -cp "./lib/*;./plugins/*"
org.apache.nutch.*
*rawl.Injector ./data ./seeds*
14/03/23 10:09:23 INFO crawl.Injector: Injector: starting at 2014-03-23
10:09:2

14/03/23 10:09:23 INFO crawl.Injector: Injector: crawlDb: data
14/03/23 10:09:23 INFO crawl.Injector: Injector: urlDir: seeds
14/03/23 10:09:23 INFO crawl.Injector: Injector: Converting injected urls
to cr
wl db entries.
14/03/23 10:09:23 WARN util.NativeCodeLoader: Unable to load native-hadoop
libr
ry for your platform... using builtin-java classes where applicable
14/03/23 10:09:23 ERROR security.UserGroupInformation:
PriviledgedActionExcepti
n as:Sourajit cause:java.io.IOException: Failed to set permissions of path:
\tm
\hadoop-Sourajit\mapred\staging\Sourajit-715250540\.staging to 0700
14/03/23 10:09:23 ERROR crawl.Injector: Injector: java.io.IOException:
Failed t
 set permissions of path:
\tmp\hadoop-Sourajit\mapred\staging\Sourajit-71525054
\.staging to 0700
        at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
        at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
        at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSy
tem.java:509)
        at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.ja
a:344)
        at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:1
9)
        at
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubm
ssionFiles.java:116)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Unknown Source)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInform
tion.java:1121)
        at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:
50)
        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
        at org.apache.nutch.crawl.Injector.inject(Injector.java:217)
        at org.apache.nutch.crawl.Injector.run(Injector.java:248)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.nutch.crawl.Injector.main(Injector.java:238)

Reply via email to