Hi Sourajit, You may want to check this https://github.com/congainc/patch-hadoop_7682-1.0.x-win as it will create a workaround to skip the checking of permissions of the tmp dir.
Regards, Rahul -----Original Message----- From: Sourajit Basak [mailto:[email protected]] Sent: Sunday, March 23, 2014 10:19 AM To: [email protected] Subject: running Nutch on windows using plain command line The objective is to test plugins and the environment is Windows. However, nutch doesn't seem to work with this plain command line, Why is it thinking distributed mode ? D:\SEMANT~1\CRAWL_~1>*java -Xmx1000M -cp "./lib/*;./plugins/*" org.apache.nutch.* *rawl.Injector ./data ./seeds* 14/03/23 10:09:23 INFO crawl.Injector: Injector: starting at 2014-03-23 10:09:2 14/03/23 10:09:23 INFO crawl.Injector: Injector: crawlDb: data 14/03/23 10:09:23 INFO crawl.Injector: Injector: urlDir: seeds 14/03/23 10:09:23 INFO crawl.Injector: Injector: Converting injected urls to cr wl db entries. 14/03/23 10:09:23 WARN util.NativeCodeLoader: Unable to load native-hadoop libr ry for your platform... using builtin-java classes where applicable 14/03/23 10:09:23 ERROR security.UserGroupInformation: PriviledgedActionExcepti n as:Sourajit cause:java.io.IOException: Failed to set permissions of path: \tm \hadoop-Sourajit\mapred\staging\Sourajit-715250540\.staging to 0700 14/03/23 10:09:23 ERROR crawl.Injector: Injector: java.io.IOException: Failed t set permissions of path: \tmp\hadoop-Sourajit\mapred\staging\Sourajit-71525054 \.staging to 0700 at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689) at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSy tem.java:509) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.ja a:344) at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:1 9) at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubm ssionFiles.java:116) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Unknown Source) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInform tion.java:1121) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java: 50) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824) at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261) at org.apache.nutch.crawl.Injector.inject(Injector.java:217) at org.apache.nutch.crawl.Injector.run(Injector.java:248) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.nutch.crawl.Injector.main(Injector.java:238) This email and any attachments are confidential, and may be legally privileged and protected by copyright. If you are not the intended recipient dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Any views or opinions are solely those of the sender. This communication is not intended to form a binding contract unless expressly indicated to the contrary and properly authorised. Any actions taken on the basis of this email are at the recipient's own risk.
