Saurabh Chawla created SPARK-30582:
--------------------------------------
Summary: Spark UI is not showing Aggregated Metrics by Executor in
stage page
Key: SPARK-30582
URL: https://issues.apache.org/jira/browse/SPARK-30582
Project: Spark
Issue Type: Bug
Components: Web UI
Affects Versions: 3.0.0
Reporter: Saurabh Chawla
Fix For: 3.0.0
Attachments: SparkUIStagePage.mov
There are scenarios where Spark History Server is located behind the VPC. So
whenever api calls hit to get the executor Summary(allexecutors). There can be
delay in getting the response of executor summary and in mean time
"stage-page-template.html" is loaded and the response of executor Summary is
not added to the stage-page-template.html.
As the result of which Aggregated Metrics by Executor in stage page is showing
blank.
This scenario can be easily found in the cases when there is some proxy-server
which is responsible for sending the request and response to spark History
server.
This can be reproduced in Knox/In-house proxy servers which are used to send
and receive response to Spark History Server.
Alternative scenario to test this case, Open the spark UI in developer mode in
browser add some breakpoint in stagepage.js, this will add some delay in
getting the response and now if we check the spark UI for stage Aggregated
Metrics by Executor in stage page is showing blank.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
