Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/7770#issuecomment-127122956
@squito regarding accumulators, there was an earlier patch that supports
incremental updates of accumulators, so we can use them for this type of
measurement now. Over time IMO we should move most of the metrics into
accumulators since that's a built in mechanism for doing exactly this type of
measurement, and involves fewer hard-coded changes when we want to add new
instrumentation. TaskMetrics was sort of a parallel feature that developed but
now has almost 100% overlap with the accumulators concept.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
