GitHub user CodingCat opened a pull request:
https://github.com/apache/spark/pull/15675
[SPARK-18144][SQL] logging StreamingQueryListener$QueryStartedEvent
## What changes were proposed in this pull request?
The PR fixes the bug that the QueryStartedEvent is not logged
The reason of the bug is that listeners in `ListenerBus` is typed as
CopyOnWriteArray so that the thread calling postToAll to post QueryStartedEvent
will see an empty `listeners` (stale version). In fact, we should never call
postToAll() directly but call `LiveListenerBus.post()` to broadcast events
@zsxwing
## How was this patch tested?
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/CodingCat/spark SPARK-18144
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15675.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15675
----
commit 5a8dc877d5d279983754919f3e44a4ba7cb3c2fa
Author: CodingCat <[email protected]>
Date: 2016-03-07T14:37:37Z
improve the doc for "spark.memory.offHeap.size"
commit 46788bd26737a53c5bc76089012ecb2515f0260b
Author: CodingCat <[email protected]>
Date: 2016-03-07T19:00:16Z
fix
commit 766c67d4d1609782bf7558a2b7c742df72bff620
Author: CodingCat <[email protected]>
Date: 2016-10-28T20:20:47Z
postToAll has to be called in the same thread
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
