[
https://issues.apache.org/jira/browse/HIVE-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15857950#comment-15857950
]
Xuefu Zhang edited comment on HIVE-15671 at 2/8/17 12:57 PM:
-------------------------------------------------------------
[~KaiXu], your case might be different. The connection is explicitly closed due
to
{code}
2017-02-08T09:51:04,346 INFO [stderr-redir-1] client.SparkClientImpl: 17/02/08
09:51:04 WARN rpc.RpcDispatcher: [DriverProtocol] Expected RPC header, got
org.apache.hive.spark.client.rpc.Rpc$NullMessage instead.
2017-02-08T09:51:04,347 INFO [stderr-redir-1] client.SparkClientImpl: 17/02/08
09:51:04 INFO rpc.RpcDispatcher: [DriverProtocol] Closing channel due to
exception in pipeline (null).
2017-02-08T09:51:04,347 INFO [RPC-Handler-3] rpc.RpcDispatcher:
[ClientProtocol] Closing channel due to exception in pipeline (Connection reset
by peer).
{code}
I haven't seen this kind of exception, so am not sure how it happens. If this
can be reproduced, complete logs (driver, hive, yarn) would be helpful.
was (Author: xuefuz):
[~KaiXu], your case might be different. The connection is explicitly closed due
to
{code}
2017-02-08T09:51:04,346 INFO [stderr-redir-1] client.SparkClientImpl: 17/02/08
09:51:04 WARN rpc.RpcDispatcher: [DriverProtocol] Expected RPC header, got
org.apache.hive.spark.client.rpc.Rpc$NullMessage instead.
2017-02-08T09:51:04,347 INFO [stderr-redir-1] client.SparkClientImpl: 17/02/08
09:51:04 INFO rpc.RpcDispatcher: [DriverProtocol] Closing channel due to
exception in pipeline (null).
2017-02-08T09:51:04,347 INFO [RPC-Handler-3] rpc.RpcDispatcher:
[ClientProtocol] Closing channel due to exception in pipeline (Connection reset
by peer).
{code}
I haven't seen this kind of exception, so am not sure how it happens.
> RPCServer.registerClient() erroneously uses server/client handshake timeout
> for connection timeout
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-15671
> URL: https://issues.apache.org/jira/browse/HIVE-15671
> Project: Hive
> Issue Type: Bug
> Components: Spark
> Affects Versions: 1.1.0
> Reporter: Xuefu Zhang
> Assignee: Xuefu Zhang
> Attachments: HIVE-15671.1.patch, HIVE-15671.patch
>
>
> {code}
> /**
> * Tells the RPC server to expect a connection from a new client.
> * ...
> */
> public Future<Rpc> registerClient(final String clientId, String secret,
> RpcDispatcher serverDispatcher) {
> return registerClient(clientId, secret, serverDispatcher,
> config.getServerConnectTimeoutMs());
> }
> {code}
> {{config.getServerConnectTimeoutMs()}} returns value for
> *hive.spark.client.server.connect.timeout*, which is meant for timeout for
> handshake between Hive client and remote Spark driver. Instead, the timeout
> should be *hive.spark.client.connect.timeout*, which is for timeout for
> remote Spark driver in connecting back to Hive client.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
