[
https://issues.apache.org/jira/browse/HCATALOG-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13254895#comment-13254895
]
Mithun Radhakrishnan commented on HCATALOG-236:
-----------------------------------------------
Yep, the patch for HIVE-2883 does indeed fix this issue. The problem was that
the transport was being used after it was closed (when the client is closed).
> Exception during local-metastore shutdown on HCat-client.
> ---------------------------------------------------------
>
> Key: HCATALOG-236
> URL: https://issues.apache.org/jira/browse/HCATALOG-236
> Project: HCatalog
> Issue Type: Bug
> Components: metastore
> Affects Versions: 0.3
> Environment: Pig 0.9, HCat 0.3, Hive 0.9, Hadoop 0.20.205, Thrift
> 0.7.0.
> Reporter: Mithun Radhakrishnan
>
> Here's an exception that we see when HiveMetastoreClient.close() is called:
> org.apache.thrift.transport.TTransportException: SASL authentication not
> complete
> at
> org.apache.thrift.transport.TSaslTransport.write(TSaslTransport.java:443)
> at
> org.apache.thrift.transport.TSaslClientTransport.write(TSaslClientTransport.java:37)
> at
> org.apache.hadoop.hive.thrift.TFilterTransport.write(TFilterTransport.java:72)
> at
> org.apache.thrift.protocol.TBinaryProtocol.writeI32(TBinaryProtocol.java:163)
> at
> org.apache.thrift.protocol.TBinaryProtocol.writeMessageBegin(TBinaryProtocol.java:91)
> at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)
> at
> com.facebook.fb303.FacebookService$Client.send_shutdown(FacebookService.java:421)
> at
> com.facebook.fb303.FacebookService$Client.shutdown(FacebookService.java:415)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:308)
> at
> org.apache.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:116)
> at
> org.apache.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:40)
> at org.apache.hcatalog.pig.HCatLoader.setLocation(HCatLoader.java:90)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:263)
> at
> org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:962)
> at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:979)
> at org.apache.hadoop.mapred.JobClient.access$600(JobClient.java:174)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:897)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1082)
> at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
> at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:378)
> at
> org.apache.hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247)
> at
> org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279)
> at java.lang.Thread.run(Thread.java:619)
> We see this both from Pig (0.9) Grunt-shell and in the Output-committer
> task-logs. Doesn't happen on HCat 0.2 (Hive0.8 + Thrift 0.5.0).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
