[GitHub] spark pull request #23240: [SPARK-26281][WebUI] Duration column of task tabl...

[gengliangwang]

GitHub user gengliangwang opened a pull request:

    https://github.com/apache/spark/pull/23240

    [SPARK-26281][WebUI] Duration column of task table should be executor run 
time instead of real duration

    ## What changes were proposed in this pull request?
    
    In PR https://github.com/apache/spark/pull/23081/ , the duration column is 
changed to executor run time. The behavior is consistent with the summary 
metrics table and previous Spark version.
    
    However, after PR https://github.com/apache/spark/pull/21688, the issue can 
be reproduced again.
    
    ## How was this patch tested?
    
    Before the change, we can see:
    
    1. The minimum duration in aggregation table doesn't match with the task 
table below.
    2. The sorting order is wrong.
    
![image](https://user-images.githubusercontent.com/1097932/49533048-f7eecb80-f8f8-11e8-9256-2eb524e81be0.png)
    
    After the change, the issues are fixed:
    
![image](https://user-images.githubusercontent.com/1097932/49533069-06d57e00-f8f9-11e8-872b-402e3014f557.png)
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gengliangwang/spark fixDuration

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/23240.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #23240
    
----
commit 612c4c7242f6289d3a1e424a69951be25cd126af
Author: Gengliang Wang <gengliang.wang@...>
Date:   2018-12-05T17:44:55Z

    fix

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org