Jacek Lewandowski created SPARK-11726:
-----------------------------------------
Summary: Legacy Netty-RPC based submission in standalone mode does
not work
Key: SPARK-11726
URL: https://issues.apache.org/jira/browse/SPARK-11726
Project: Spark
Issue Type: Bug
Components: Deploy, Spark Submit
Reporter: Jacek Lewandowski
When the application is to be submitted in cluster mode and standalone Spark
scheduler is used either legacy RPC based protocol or REST based protocol can
be used. Spark submit firstly tries REST and if it fails it tries RPC.
When Akka based RPC is used, the REST based connection fails immediately
because Akka rejects non-Akka connection. However in Netty based RPC, the REST
client seems to wait for the response indefinitely, thus making it impossible
to fail and try RPC.
The fix is quite simple - set a timeout on reading response from the server.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
