[GitHub] [spark] AngersZhuuuu commented on pull request #31048: [SPARK-34019][WEBUI] Keep same quantiles of task summary between Web UI and restful API

[GitBox]

AngersZhuuuu commented on pull request #31048:
URL: https://github.com/apache/spark/pull/31048#issuecomment-756773764


   > What does the UI look like before and after? what is in the REST API not 
in the UI?
   
   The problem is :
   
   1. In spark web ui task summary the quantiles is `0.0.0.25,0.5,0.75,1.0`
   2. In restful API 
/applications/[app-id]/stages/[stage-id]/[stage-attempt-id]/taskSummary the 
quantiles is `0.05,0.25,0.5,0.75,1.0`
   
   The result is not same, we'd better keep it consistent
   
   For one APP running in our env, stage=4 & stageAttemptId=0 
   We can see the scheduler delay. the value is not same.
   <img width="1377" alt="Screen Shot 2021-01-08 at 10 03 21 PM" 
src="https://user-images.githubusercontent.com/46485123/104024432-11f8e780-51fe-11eb-92b8-dd84a550d829.png";>
   <img width="1310" alt="Screen Shot 2021-01-08 at 10 03 46 PM" 
src="https://user-images.githubusercontent.com/46485123/104024442-16250500-51fe-11eb-9dc0-7a8a93fae176.png";>
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org