Ryan Williams created SPARK-5106:
------------------------------------

             Summary: Make Web UI automatically refresh/update displayed data
                 Key: SPARK-5106
                 URL: https://issues.apache.org/jira/browse/SPARK-5106
             Project: Spark
          Issue Type: Improvement
          Components: Web UI
    Affects Versions: 1.2.0
            Reporter: Ryan Williams


My (and presumably others') experience monitoring Spark jobs currently consists 
of repeatedly ⌘R'ing various pages of the web UI to view ever-fresher data 
about how many tasks have succeeded / failed, how much spillage is happening, 
etc., which is tedious.

Particularly unfortunate is the "one refresh over the line" problem where, just 
as things are getting interesting, the job itself fails or finishes, and after 
refreshing the page all data disappears.

It would be good if the web UI updated the data it was displaying automatically.

One hacky way to achieve this would be to have it automatically refresh the 
page, though this still risks losing everything when the job finishes.

A better long-term solution would be to have the UI poll for (or have pushed to 
it) updates to the data it is displaying.

Either way, some way to toggle this functionality on or off is probably 
warranted as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to