[
https://issues.apache.org/jira/browse/HCATALOG-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250802#comment-13250802
]
Travis Crawford commented on HCATALOG-236:
------------------------------------------
I see this too. The exception is a little different (no SASL).
{code}
2012-04-05 22:04:15,972 [main] INFO hive.metastore - Trying to connect to
metastore with URI thrift://foo.com:40007
2012-04-05 22:04:15,973 [main] INFO hive.metastore - Connected to metastore.
2012-04-05 22:04:17,499 [main] ERROR hive.metastore - Unable to shutdown local
metastore client
org.apache.thrift.transport.TTransportException: Cannot write to null
outputStream
at
org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:142)
at
org.apache.thrift.transport.TFramedTransport.flush(TFramedTransport.java:156)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:65)
at
com.facebook.fb303.FacebookService$Client.send_shutdown(FacebookService.java:421)
at
com.facebook.fb303.FacebookService$Client.shutdown(FacebookService.java:415)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:312)
at
org.apache.hcatalog.mapreduce.InitializeInput.getSerializedHcatKeyJobInfo(InitializeInput.java:130)
at
org.apache.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:76)
at
org.apache.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:40)
at org.apache.hcatalog.pig.HCatLoader.setLocation(HCatLoader.java:91)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:387)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:263)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:151)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1270)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1255)
at org.apache.pig.PigServer.storeEx(PigServer.java:952)
at org.apache.pig.PigServer.store(PigServer.java:919)
at org.apache.pig.PigServer.openIterator(PigServer.java:832)
at
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
at org.apache.pig.Main.run(Main.java:561)
at org.apache.pig.Main.main(Main.java:111)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
{code}
> Exception during local-metastore shutdown on HCat-client.
> ---------------------------------------------------------
>
> Key: HCATALOG-236
> URL: https://issues.apache.org/jira/browse/HCATALOG-236
> Project: HCatalog
> Issue Type: Bug
> Components: metastore
> Affects Versions: 0.3
> Environment: Pig 0.9, HCat 0.3, Hive 0.9, Hadoop 0.20.205, Thrift
> 0.7.0.
> Reporter: Mithun Radhakrishnan
>
> Here's an exception that we see when HiveMetastoreClient.close() is called:
> org.apache.thrift.transport.TTransportException: SASL authentication not
> complete
> at
> org.apache.thrift.transport.TSaslTransport.write(TSaslTransport.java:443)
> at
> org.apache.thrift.transport.TSaslClientTransport.write(TSaslClientTransport.java:37)
> at
> org.apache.hadoop.hive.thrift.TFilterTransport.write(TFilterTransport.java:72)
> at
> org.apache.thrift.protocol.TBinaryProtocol.writeI32(TBinaryProtocol.java:163)
> at
> org.apache.thrift.protocol.TBinaryProtocol.writeMessageBegin(TBinaryProtocol.java:91)
> at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)
> at
> com.facebook.fb303.FacebookService$Client.send_shutdown(FacebookService.java:421)
> at
> com.facebook.fb303.FacebookService$Client.shutdown(FacebookService.java:415)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:308)
> at
> org.apache.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:116)
> at
> org.apache.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:40)
> at org.apache.hcatalog.pig.HCatLoader.setLocation(HCatLoader.java:90)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:263)
> at
> org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:962)
> at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:979)
> at org.apache.hadoop.mapred.JobClient.access$600(JobClient.java:174)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:897)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1082)
> at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
> at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:378)
> at
> org.apache.hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247)
> at
> org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279)
> at java.lang.Thread.run(Thread.java:619)
> We see this both from Pig (0.9) Grunt-shell and in the Output-committer
> task-logs. Doesn't happen on HCat 0.2 (Hive0.8 + Thrift 0.5.0).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira