GitHub user cloud-fan opened a pull request:
https://github.com/apache/spark/pull/17931
[SPARK-12837][CORE][FOLLOWUP] getting name should not fail if accumulator
is garbage collected
## What changes were proposed in this pull request?
After https://github.com/apache/spark/pull/17596 , we do not send internal
accumulator name to executor side anymore, and always look up the accumulator
name in `AccumulatorContext`.
This cause a regression if the accumulator is already garbage collected,
this PR fixes this by still sending accumulator name for `SQLMetrics`.
## How was this patch tested?
N/A
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/cloud-fan/spark bug
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/17931.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #17931
----
commit 5ae4f6e147a97c4c4af5d82810597ad92b10ad1f
Author: Wenchen Fan <[email protected]>
Date: 2017-05-10T05:26:32Z
getting name should not fail if accumulator is garbage collected
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
