Hey Seetharam, Thanks for your suggestion. So I have done the following:
1. I've put hive-site.xml into oozie/conf/hadoop-conf 2. I've made sure hive.metastore.execute.setugi is true (it is true by default actually) 3. I've copied the source cluster hadoop xml's into oozie/conf/hadoop-conf per https://git-wip-us.apache.org/repos/asf?p=incubator-falcon.git;a=blob;f=docs/src/site/twiki/HiveIntegration.twiki;h=2af5a6b8351c09c60d73531470b959e801f19b97;hb=HEAD so far it is still complaining for the same error. I am thinking on running through the hive integration documentation page from scratch again to see if it changes things. Thanks, John 2014-06-30 10:05 GMT-07:00 Seetharam Venkatesh <[email protected]>: > I'm not sure if you have the latest sandbox but you'd need to add > hive-site.xml in oozie and have hive.metastore.execute.setugi set to true > for this to work. > > This has been fixed in the next patch release. > > > On Fri, Jun 27, 2014 at 11:50 PM, John Yu <[email protected]> wrote: > > > Hello Everyone, > > > > I am trying to get a Hcat based feed replication going between clusters, > > and is running into the below error (full stack trace and related > > information will be provided below) > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Exception > while > > registering > > > > org.apache.hadoop.security.token.SecretManager$InvalidToken: Password > > not found for ApplicationAttempt appattempt_1403829424249_0002_000001 > > > > > > Wondering if someone can provide insights into what might be happening > > here, or where to start trying to resolve this issue. Any pointers would > > be greatly appreciated. > > > > Thanks! > > John > > > > > > --- System --- > > Hortonworks Sandbox 2.1 > > Hadoop 2.4.0 > > Hive 0.13.0 > > Falcon 0.5 > > Oozie 4.0.0 > > > > The setup is between two HDP 2.1 sandboxes hosted on different boxes > > > > > > --- Hive site.xml --- > > > > (are these the only two properties I have to worry about? ) > > > > <property> > > > > <name>hive.security.authorization.enabled</name> > > > > <value>false (originally true) </value> > > > > </property> > > > > <property> > > > > <name>hive.server2.enable.doAs</name> > > > > <value>true (originally false) </value> > > > > </property> > > > > ---Error Stacktrace > > > > 2014-06-26 17:52:58,418 WARN [main] org.apache.hadoop.ipc.Client: > > Exception encountered while connecting to the server : > > > > > org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): > > Password not found for ApplicationAttempt > > appattempt_1403829424249_0002_000001 > > 2014-06-26 17:52:58,425 ERROR [main] > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Exception > > while registering > > org.apache.hadoop.security.token.SecretManager$InvalidToken: Password > > not found for ApplicationAttempt appattempt_1403829424249_0002_000001 > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > > Method) > > at > > > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > > at > > > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > > at > java.lang.reflect.Constructor.newInstance(Constructor.java:526) > > at > > org.apache.hadoop.yarn.ipc.RPCUtil.instantiateException(RPCUtil.java:53) > > at > > > org.apache.hadoop.yarn.ipc.RPCUtil.unwrapAndThrowException(RPCUtil.java:104) > > at > > > org.apache.hadoop.yarn.api.impl.pb.client.ApplicationMasterProtocolPBClientImpl.registerApplicationMaster(ApplicationMasterProtocolPBClientImpl.java:109) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at > > > org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:190) > > at > > > org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:103) > > at com.sun.proxy.$Proxy35.registerApplicationMaster(Unknown > Source) > > at > > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.register(RMCommunicator.java:155) > > at > > > org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStart(RMCommunicator.java:116) > > at > > > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStart(RMContainerAllocator.java:213) > > at > > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > > at > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.serviceStart(MRAppMaster.java:817) > > at > > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > > at > > > org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) > > at > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1075) > > at > > org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) > > at > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:1460) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:415) > > at > > > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557) > > at > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1456) > > at > > > org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1389) > > Caused by: > > > org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): > > Password not found for ApplicationAttempt > > appattempt_1403829424249_0002_000001 > > at org.apache.hadoop.ipc.Client.call(Client.java:1410) > > at org.apache.hadoop.ipc.Client.call(Client.java:1363) > > at > > > org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) > > at com.sun.proxy.$Proxy34.registerApplicationMaster(Unknown > Source) > > at > > > org.apache.hadoop.yarn.api.impl.pb.client.ApplicationMasterProtocolPBClientImpl.registerApplicationMaster(ApplicationMasterProtocolPBClientImpl.java:106) > > > > > > > > -- > > 余守中 John Yu (Yu, Shoou-Jong) > > Mobile: 650-691-3314 > > > > > > -- > Regards, > Venkatesh > > “Perfection (in design) is achieved not when there is nothing more to add, > but rather when there is nothing more to take away.” > - Antoine de Saint-Exupéry > -- 余守中 John Yu (Yu, Shoou-Jong) Mobile: 650-691-3314
