yuangjiang commented on issue #965: URL: https://github.com/apache/incubator-seatunnel/issues/965#issuecomment-1019199357
Spark tasks are divided into shuffle tasks and non-shuffle tasks: 1. The shuffle task indicator is placed in @shuffleMetircs 2. Non-shuffle tasks are placed in input/outputMetrics Question 1: How to ensure the accuracy of the indicator data is compatible with two types of indicator statistics at the same time? Question 2: In the process of index statistics, we found that the data size index statistics are inaccurate and need to be solved Question 3: The number of statistical data can be statistically accurate @CalvinKirs @garyelephant -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
