[ThriftServer] User permissions warning

2015-04-08 Thread Yana Kadiyska
Hi folks, I am noticing a pesky and persistent warning in my logs (this is
from Spark 1.2.1):


15/04/08 15:23:05 WARN ShellBasedUnixGroupsMapping: got exception
trying to get groups for user anonymous
org.apache.hadoop.util.Shell$ExitCodeException: id: anonymous: No such user

at org.apache.hadoop.util.Shell.runCommand(Shell.java:261)
at org.apache.hadoop.util.Shell.run(Shell.java:188)
at 
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:381)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:467)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:450)
at 
org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getUnixGroups(ShellBasedUnixGroupsMapping.java:86)
at 
org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getGroups(ShellBasedUnixGroupsMapping.java:55)
at 
org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.getGroups(JniBasedUnixGroupsMappingWithFallback.java:50)
at org.apache.hadoop.security.Groups.getGroups(Groups.java:89)
at 
org.apache.hadoop.security.UserGroupInformation.getGroupNames(UserGroupInformation.java:1292)
at 
org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator.setConf(HadoopDefaultAuthenticator.java:62)
at 
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)
at 
org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthenticator(HiveUtils.java:365)
at 
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:278)

​

I cannot figure out what I might be missing -- the thrift server is started
via sbin/start-thriftserver --master ..., I can see that the process is
running under my user. I don't have any functional issues but this is
annoying (filling up my logs/making it heard to read). Can someone give me
pointers on what to check?
Things I've tried:

1. hive.server2.enable.doAs is NOT set in hive-site.xml so I expect user
should at least show up as my id, not anonymous
2.export HADOOP_USER_NAME=someusername -- error still shows up about
anonymous

Curious if anyone has solved this


Re: [ThriftServer] User permissions warning

2015-04-08 Thread Cheng Lian
The Thrift server hasn't support authentication or Hadoop doAs yet, so 
you can simply ignore this warning.


To avoid this, when connecting via JDBC you may specify the user to the 
same user who starts the Thrift server process. For Beeline, use -n 
user.


On 4/8/15 11:49 PM, Yana Kadiyska wrote:
Hi folks, I am noticing a pesky and persistent warning in my logs 
(this is from Spark 1.2.1):


|
15/04/08 15:23:05 WARN ShellBasedUnixGroupsMapping: got exception trying to get 
groups for user anonymous
org.apache.hadoop.util.Shell$ExitCodeException: id: anonymous: No such user

 at org.apache.hadoop.util.Shell.runCommand(Shell.java:261)
 at org.apache.hadoop.util.Shell.run(Shell.java:188)
 at 
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:381)
 at org.apache.hadoop.util.Shell.execCommand(Shell.java:467)
 at org.apache.hadoop.util.Shell.execCommand(Shell.java:450)
 at 
org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getUnixGroups(ShellBasedUnixGroupsMapping.java:86)
 at 
org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getGroups(ShellBasedUnixGroupsMapping.java:55)
 at 
org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.getGroups(JniBasedUnixGroupsMappingWithFallback.java:50)
 at org.apache.hadoop.security.Groups.getGroups(Groups.java:89)
 at 
org.apache.hadoop.security.UserGroupInformation.getGroupNames(UserGroupInformation.java:1292)
 at 
org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator.setConf(HadoopDefaultAuthenticator.java:62)
 at 
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)
 at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)
 at 
org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthenticator(HiveUtils.java:365)
 at 
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:278)
|
​

I cannot figure out what I might be missing -- the thrift server is 
started via sbin/start-thriftserver --master ..., I can see that the 
process is running under my user. I don't have any functional issues 
but this is annoying (filling up my logs/making it heard to read). Can 
someone give me pointers on what to check?

Things I've tried:

1. hive.server2.enable.doAs is NOT set in hive-site.xml so I expect 
user should at least show up as my id, not anonymous
2.export HADOOP_USER_NAME=someusername -- error still shows up about 
anonymous


Curious if anyone has solved this