Ingo Schuster created SPARK-21176:
-------------------------------------
Summary: Master UI hangs with spark.ui.reverseProxy=true if the
master node has many CPUs
Key: SPARK-21176
URL: https://issues.apache.org/jira/browse/SPARK-21176
Project: Spark
Issue Type: Bug
Components: Web UI
Affects Versions: 2.1.0
Environment: ppc64le GNU/Linux, POWER8, only master node is reachable
externally other nodes are in an internal network
Reporter: Ingo Schuster
When *reverse proxy is enabled*
{quote}
spark.ui.reverseProxy=true
spark.ui.reverseProxyUrl=/
{quote}
first of all any invocation of the spark master Web UI hangs forever locally
(e.g. http://192.168.10.16:25001) and via external URL without any data
received.
One, sometimes two spark applications succeed without error and than workers
start throwing exceptions:
{quote}
Caused by: java.io.IOException: Failed to connect to /192.168.10.16:25050
{quote}
The application dies during creation of SparkContext:
{quote}
2017-05-22 16:11:23 INFO StandaloneAppClient$ClientEndpoint:54 - Connecting to
master spark://node0101:25000...
2017-05-22 16:11:23 INFO TransportClientFactory:254 - Successfully created
connection to node0101/192.168.10.16:25000 after 169 ms (132 ms spent in
bootstraps)
2017-05-22 16:11:43 INFO StandaloneAppClient$ClientEndpoint:54 - Connecting to
master spark://node0101:25000...
2017-05-22 16:12:03 INFO StandaloneAppClient$ClientEndpoint:54 - Connecting to
master spark://node0101:25000...
2017-05-22 16:12:23 ERROR StandaloneSchedulerBackend:70 - Application has been
killed. Reason: All masters are unresponsive! Giving up.
2017-05-22 16:12:23 WARN StandaloneSchedulerBackend:66 - Application ID is not
initialized yet.
2017-05-22 16:12:23 INFO Utils:54 - Successfully started service
'org.apache.spark.network.netty.NettyBlockTransferService' on port 25056.
.....
Caused by: java.lang.IllegalArgumentException: requirement failed: Can only
call getServletHandlers on a running MetricsSystem
{quote}
*This definitively does not happen without reverse proxy enabled!*
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
