I'm running the Nutch crawler remotely, a server that is physically disparate from the Solr servers and from the website that is being crawled.
It appears that Nutch 1.5.1 prefers to run on Linux. We're attempting to run it on AIX. I don't recall having this issue with 1.4, unless I need to find a different package. From: Lewis John Mcgibbney <[email protected]> To: [email protected] Date: 08/04/2012 10:00 AM Subject: Re: Upgrade nutch 1.4 to 1.5.1 getting 'failed to login' Hi, do you run Nutch locally, pseudo distrib...? Lewis On Fri, Aug 3, 2012 at 4:37 PM, James F Walton <[email protected]> wrote: > I took my existing, functional configurations from my 1.4 installation and > brought everything over to run on 1.5.1. Now when I attempt to run a > crawl, I'm getting these errors. > > 2012-08-02 20:03:21,271 ERROR crawl.Injector - Injector: > java.lang.RuntimeException: java.io.IOException: failure to login > at > org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:546) > at > org.apache.hadoop.mapred.FileInputFormat.addInputPath(FileInputFormat.java:336) > at org.apache.nutch.crawl.Injector.inject(Injector.java:209) > at org.apache.nutch.crawl.Injector.run(Injector.java:248) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.nutch.crawl.Injector.main(Injector.java:238) > Caused by: java.io.IOException: failure to login > at > org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:490) > at > org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:452) > at > org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123) > at > org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:542) > ... 5 more > Caused by: javax.security.auth.login.LoginException: unable to find > LoginModule class: com.ibm.security.auth.module.LinuxLoginModule > at > javax.security.auth.login.LoginContext.invoke(LoginContext.java:834) > at > javax.security.auth.login.LoginContext.access$000(LoginContext.java:209) > at > javax.security.auth.login.LoginContext$5.run(LoginContext.java:732) > at > java.security.AccessController.doPrivileged(AccessController.java:284) > at > javax.security.auth.login.LoginContext.invokeCreatorPriv(LoginContext.java:729) > at > javax.security.auth.login.LoginContext.login(LoginContext.java:599) > at > org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:471) > ... 11 more > > > It looks like there is some Hadoop security thing that is failing based on > a missing module, or the wrong module. > This is on AIX 6.1 with 64-bit IBM JRE 1.6.0 SR9 FP2 (aka Java6) > > Is there a higher Java level requirement that I missed? Missing > configuration change that needs to be in place for 1.5.1 that wasn't in > 1.4? > Any help is appreciated. > > James -- Lewis
