mingmwang commented on issue #3033: URL: https://github.com/apache/arrow-datafusion/issues/3033#issuecomment-1206105534
If we do not have unique ids to represent the MetricsSet, we have to use some other implicit ways to correlate the metrics. One solution is to leverage the array index. For example after the Executor finish a task, traverse the plan tree and collect all the MetricsSets into an Array of MetricsSet. The order of the MetricSet in the Array matters. in the Scheduler side, multiple tasks report back the MetricsSets, MetricsSets will be merged base on the array index. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
