gengliangwang commented on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-793884402
@AngersZhuuuu the second graph you posted is from stage page. AFAIK the duration is the sum of executor run times. While in job/sql page the duration is completion_time - submit_time. Your example seems unrelated to this PR. Again, I don't think committing a job should be too long. The metrics is also confusing. I will keep my -1. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
