[jira] [Commented] (HIVE-12548) Hive metastore goes down in Kerberos,sentry enabled CDH5.5 cluster

[Andrew Olson (JIRA)]

    [ 
https://issues.apache.org/jira/browse/HIVE-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064686#comment-15064686
 ] 

Andrew Olson commented on HIVE-12548:
-------------------------------------

After much debugging we were finally able to figure this out. Here are some 
code and config snippets that might be helpful for anyone else who runs into 
this cryptic exception.

{noformat}
for (Token<?> token : UserGroupInformation.getCurrentUser().getTokens()) {
  if (token.getKind().equals(DelegationTokenIdentifier.HIVE_DELEGATION_KIND)) {
    conf.set(HIVE_METASTORE_TOKEN_SIGNATURE_PROPERTY, 
token.getService().toString());
    break;
  }
}
{noformat}

{noformat}
HiveConf hiveConf = new HiveConf();
hiveConf.addResource(conf);
{noformat}

{noformat}
if (System.getProperty("oozie.action.conf.xml") != null) {
  conf.addResource(new Path("file:///", 
System.getProperty("oozie.action.conf.xml")));
}
conf.addResource("hive-site.xml");
{noformat}

{noformat}
if (System.getenv("HADOOP_TOKEN_FILE_LOCATION") != null) {
  conf.set("mapreduce.job.credentials.binary", 
System.getenv("HADOOP_TOKEN_FILE_LOCATION"));
}
{noformat}

{noformat}
conf.set("yarn.application.classpath", conf.get("yarn.application.classpath") + 
",/opt/cloudera/parcels/CDH/lib/hive/lib/*");
{noformat}

{noformat}
    <global>
        <job-tracker>${jobTracker}</job-tracker>
        <name-node>${nameNode}</name-node>
        <job-xml>${concat(additionsPath, 'hive-site.xml')}</job-xml>
        <job-xml>${concat(hadoopPropertyFilesPath, 'global-conf.xml')}</job-xml>
        <configuration>
            <property>
                <name>oozie.launcher.mapreduce.job.user.classpath.first</name>
                <value>true</value>
            </property>
        </configuration>
    </global>

    <credentials>
        <credential name='hive_credentials' type='hcat'>
            <property>
                <name>hcat.metastore.uri</name>
                <value>${hiveMetastoreURI}</value>
            </property>
            <property>
                <name>hcat.metastore.principal</name>
                <value>${hivePrincipal}</value>
            </property>
        </credential>
    </credentials>
{noformat}

> Hive metastore goes down in Kerberos,sentry enabled CDH5.5 cluster
> ------------------------------------------------------------------
>
>                 Key: HIVE-12548
>                 URL: https://issues.apache.org/jira/browse/HIVE-12548
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive, HiveServer2
>         Environment: RHEL 6.5 CLOUDERA CDH 5.5
>            Reporter: narendra reddy ganesana
>
> [pool-3-thread-10]: Error occurred during processing of message.
> java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: 
> Invalid status -128
>       at 
> org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
>       at 
> org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:739)
>       at 
> org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:736)
>       at java.security.AccessController.doPrivileged(Native Method)
>       at javax.security.auth.Subject.doAs(Subject.java:356)
>       at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1651)
>       at 
> org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:736)
>       at 
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:268)
>       at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>       at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>       at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.thrift.transport.TTransportException: Invalid status 
> -128
>       at 
> org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
>       at 
> org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
>       at 
> org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
>       at 
> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
>       at 
> org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
>       at 
> org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
>       ... 10 more



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)