Hi all
         Spark job web ui will not be available when job is over, but it is 
convenient for developer to debug with persisting job web ui. I just come up 
with draft for this issue.

1.       We could simply save the web page with html/xml 
format(stages/executors/storages/environment) to certain location when job 
finished

2.       But it is not easy for user to review the job info with #1, we could 
build extra job history service for developers

3.       But where will we build this history service? In Driver node or Master 
node?

Any suggestions about this improvement?

regards,
Andrew

Reply via email to