Hi all Spark job web ui will not be available when job is over, but it is convenient for developer to debug with persisting job web ui. I just come up with draft for this issue.
1. We could simply save the web page with html/xml format(stages/executors/storages/environment) to certain location when job finished 2. But it is not easy for user to review the job info with #1, we could build extra job history service for developers 3. But where will we build this history service? In Driver node or Master node? Any suggestions about this improvement? regards, Andrew