When I try to run a simple ls on the DFS I get a LoginException, I noticed
however that this only occurs when map reduce is running. If the DFS is
running by itself it works fine (I can ls and cat files), no errors, but
when I start map reduce the error happens.
Here is the trace:
[EMAIL PROTECTED]:~$ hadoop dfs -ls /
08/08/13 23:08:34 WARN fs.FileSystem: uri=hdfs://localhost:54310
javax.security.auth.login.LoginException: Login failed: java.io.IOException:
Cannot allocate memory
at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275)
at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:257)
at
org.apache.hadoop.security.UserGroupInformation.login(UserGroupInformation.java:67)
at
org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1353)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1289)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:203)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:108)
at org.apache.hadoop.fs.FsShell.init(FsShell.java:87)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:1717)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1866)
Bad connection to FS. command aborted.
Here is an example of what happens:
[EMAIL PROTECTED]:~$ start-dfs.sh
starting namenode, logging to
/home/hadoop/hadoop/bin/../logs/hadoop-hadoop-namenode-comp.out
localhost: starting datanode, logging to
/home/hadoop/hadoop/bin/../logs/hadoop-hadoop-datanode-comp.out
hadolocalhost: starting secondarynamenode, logging to
/home/hadoop/hadoop/bin/../logs/hadoop-hadoop-secondarynamenode-comp.out
op dfs [EMAIL PROTECTED]:~$ hadoop dfs -copyFromLocal test /test
[EMAIL PROTECTED]:~$ hadoop dfs -cat /test
THIS FILE IS ON THE DFS - IT WORKS
[EMAIL PROTECTED]:~$ start-mapred.sh
starting jobtracker, logging to
/home/hadoop/hadoop/bin/../logs/hadoop-hadoop-jobtracker-comp.out
localhost: starting tasktracker, logging to
/home/hadoop/hadoop/bin/../logs/hadoop-hadoop-tasktracker-comp.out
[EMAIL PROTECTED]:~$ hadoop dfs -cat /test
08/08/13 23:26:43 WARN fs.FileSystem: uri=hdfs://localhost:54310
javax.security.auth.login.LoginException: Login failed: java.io.IOException:
Cannot allocate memory
at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275)
at
org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:257)
at
org.apache.hadoop.security.UserGroupInformation.login(UserGroupInformation.java:67)
at
org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1353)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1289)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:203)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:108)
at org.apache.hadoop.fs.FsShell.init(FsShell.java:87)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:1717)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1866)
Bad connection to FS. command aborted.
I tried to see if it was an issue with 'whoami' but whoami displays the
correct name and there is only one binary.
Your help is appreciated
--
View this message in context:
http://www.nabble.com/Hadoop--LoginException-when-running-mapred-tp18976319p18976319.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.
