[
https://issues.apache.org/jira/browse/OOZIE-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15580093#comment-15580093
]
Abhishek Bafna commented on OOZIE-2621:
---------------------------------------
[~gezapeti] There is one more exception while running locally, but goes pass
through that.
{noformat}
18:53:34,099 WARN ShellBasedUnixGroupsMapping:86 - got exception trying to get
groups for user foo
org.apache.hadoop.util.Shell$ExitCodeException: id: foo: no such user
at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
at org.apache.hadoop.util.Shell.run(Shell.java:418)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:739)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:722)
at
org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getUnixGroups(ShellBasedUnixGroupsMapping.java:83)
at
org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getGroups(ShellBasedUnixGroupsMapping.java:52)
at
org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.getGroups(JniBasedUnixGroupsMappingWithFallback.java:50)
at org.apache.hadoop.security.Groups.getGroups(Groups.java:139)
at
org.apache.hadoop.security.UserGroupInformation$TestingGroups.getGroups(UserGroupInformation.java:1222)
at
org.apache.hadoop.security.UserGroupInformation.getGroupNames(UserGroupInformation.java:1409)
at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.<init>(FSPermissionChecker.java:81)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getPermissionChecker(FSNamesystem.java:3306)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:3487)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:779)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:764)
at
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
18:53:34,102 WARN UserGroupInformation:1412 - No groups available for user foo
18:53:34,102 INFO audit:7743 - allowed=true ugi=foo (auth:SIMPLE)
ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hive dst=null perm=null
{noformat}
Also, OOZIE-2613 introduced the below change for the {{hadoop-1}} profile.
{{MiniHCatServer#resetDefaultDBCreation}} got removed.
{code}
buffer.append("CREATE DATABASE IF NOT EXISTS default;").append(NEW_LINE);
{code}
though I tried running the testcases after removing this line, but it still
fails. (Did not see any exception but these logs)
{noformat}
20:22:29,898 WARN ObjectStore:568 - Failed to get database default, returning
NoSuchObjectException
...
20:22:43,014 INFO Hive2ActionExecutor:520 - USER[test] GROUP[-] TOKEN[]
APP[testApp] JOB[0000000-161016202228110-oozie-abaf-W]
ACTION[0000000-161016202228110-oozie-abaf-W@hive2-action] action completed,
external ID [job_1476629530322_0001]
20:22:43,051 WARN Hive2ActionExecutor:523 - USER[test] GROUP[-] TOKEN[]
APP[testApp] JOB[0000000-161016202228110-oozie-abaf-W]
ACTION[0000000-161016202228110-oozie-abaf-W@hive2-action] Launcher ERROR,
reason: Main class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]
20:22:43,053 INFO Services:520 - USER[test] GROUP[-] TOKEN[] APP[testApp]
JOB[0000000-161016202228110-oozie-abaf-W]
ACTION[0000000-161016202228110-oozie-abaf-W@hive2-action] Shutdown
{noformat}
> Use hive-exec-<version>-core instead of hive-exec in oozie-core
> ---------------------------------------------------------------
>
> Key: OOZIE-2621
> URL: https://issues.apache.org/jira/browse/OOZIE-2621
> Project: Oozie
> Issue Type: Bug
> Reporter: Peter Cseh
> Assignee: Peter Cseh
> Attachments: OOZIE-2621.001.patch
>
>
> hive-exec.jar contains the dependencies of Hive and they can cause issues on
> the classpath: HIVE-1640, HIVE-5733
> We've ran into and issue when Oozie won't start because of different Jackson
> versions.
> We should use hive-exec-core.jar (HIVE-7423) instead of hive-exec.jar which
> is a thin version of hive-exec.jar
> Pig is already using hive-exec-core:
> https://github.com/apache/pig/blob/spark/ivy.xml#L423
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)