GitHub user dbkerkela opened a pull request:
https://github.com/apache/spark/pull/21634
[SPARK-24648][SQL] SqlMetrics should be threadsafe
Use LongAdder to make SQLMetrics thread safe.
## What changes were proposed in this pull request?
Replace += with LongAdder.add() for concurrent counting
## How was this patch tested?
Unit tests with local threads
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dbkerkela/apache-spark
sqlmetrics-concurrency-stacy
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21634.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21634
----
commit deb08b9404729fc4ad6fc56a3bce7503fbc2e9e5
Author: Stacy Kerkela <stacy.kerkela@...>
Date: 2018-06-25T12:33:41Z
[SPARK-24648][SQL] SqlMetrics should be threadsafe
Use LongAdder to make SQLMetrics threadsafe.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
