Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/17540
@zsxwing, there should be a fix for the metrics without waiting for all of
the bad plans to be fixed (which is to basically eliminate the use of
`ExecutedCommandExec`).
The metrics are missing because `ExecutedCommandExec` doesn't report them
via
[`metrics`](https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala#L79).
So we need to update it to get metrics from the command that is run. That
requires breaking the command into two phases, one to get a SparkPlan and one
to run it. Right now, that all happens at once. This shouldn't be too difficult
as a follow-up, but will be a substantial number of changes so I think this PR
should be independent.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
