The Thrift server hasn't support authentication or Hadoop doAs yet, so
you can simply ignore this warning.
To avoid this, when connecting via JDBC you may specify the user to the
same user who starts the Thrift server process. For Beeline, use "-n
<user>".
On 4/8/15 11:49 PM, Yana Kadiyska wrote:
Hi folks, I am noticing a pesky and persistent warning in my logs
(this is from Spark 1.2.1):
|
15/04/08 15:23:05 WARN ShellBasedUnixGroupsMapping: got exception trying to get
groups for user anonymous
org.apache.hadoop.util.Shell$ExitCodeException: id: anonymous: No such user
at org.apache.hadoop.util.Shell.runCommand(Shell.java:261)
at org.apache.hadoop.util.Shell.run(Shell.java:188)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:381)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:467)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:450)
at
org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getUnixGroups(ShellBasedUnixGroupsMapping.java:86)
at
org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getGroups(ShellBasedUnixGroupsMapping.java:55)
at
org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.getGroups(JniBasedUnixGroupsMappingWithFallback.java:50)
at org.apache.hadoop.security.Groups.getGroups(Groups.java:89)
at
org.apache.hadoop.security.UserGroupInformation.getGroupNames(UserGroupInformation.java:1292)
at
org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator.setConf(HadoopDefaultAuthenticator.java:62)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)
at
org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthenticator(HiveUtils.java:365)
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:278)
|
I cannot figure out what I might be missing -- the thrift server is
started via sbin/start-thriftserver --master ..., I can see that the
process is running under my user. I don't have any functional issues
but this is annoying (filling up my logs/making it heard to read). Can
someone give me pointers on what to check?
Things I've tried:
1. hive.server2.enable.doAs is NOT set in hive-site.xml so I expect
user should at least show up as my id, not anonymous
2.export HADOOP_USER_NAME="someusername" -- error still shows up about
anonymous
Curious if anyone has solved this
