Hi!
1. Dev list isn't the best place for such questions. Please use nutch-user
maillist.
2. The problem is here, I guess:
java.io.IOException: Failed
to set permissions of path:
\tmp\hadoop-Dula\mapred\staging\Dula-543646770\.staging to 0700
java.io.IOException: Failed to set permissions of path:
\tmp\hadoop-Dula\mapred\staging\Dula-543646770\.staging to 0700
Make hadoop user owner of that folder(\tmp\hadoop-Dula\ , or set 777
permissions)
Best regards, Alexander.
>
> I wrote a java code to use nutch's crawling feature as
> follows.
> ...
> String arg[] = {"seedURLs", "-threads", "5", "-depth", "3",
> "-topN", "10"};
> try {
> Crawl.main(arg);
> } catch (Exception e) {
> e.printStackTrace(System.out);
> }
> ...
> Then I faced 'PrivilagedActionException' error. I think its
> related to
> the 'hadoop' component.
> Please help me with the error. Here is the detailed error.
> ...
> INFO: Injector: Converting injected urls to crawl db
> entries.
> 13/05/16 08:48:36 WARN util.NativeCodeLoader: Unable to
> load
> native-hadoop library for your platform... using
> builtin-java classes
> where applicable
> 13/05/16 08:48:36 ERROR security.UserGroupInformation:
> PriviledgedActionException as:Dula
> cause:java.io.IOException: Failed
> to set permissions of path:
> \tmp\hadoop-Dula\mapred\staging\Dula-543646770\.staging to
> 0700
> java.io.IOException: Failed to set permissions of path:
> \tmp\hadoop-Dula\mapred\staging\Dula-543646770\.staging to
> 0700
> at
> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
> at
> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
> at
> org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
> at
> org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> at
> java.security.AccessController.doPrivileged(Native Method)
> at
> javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
> at
> org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
> at
> org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
> at
> org.apache.nutch.crawl.Injector.inject(Injector.java:281)
> at
> org.apache.nutch.crawl.Crawl.run(Crawl.java:127)
> at
> org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at
> org.apache.nutch.crawl.Crawl.main(Crawl.java:55)
> ...
>
