GitHub user holdenk opened a pull request:
https://github.com/apache/spark/pull/11287
[SPARK-13398][STREAMING] Change FileWriteAheadLogger to not depend on
deprecated ThreadPoolTaskSupport
## What changes were proposed in this pull request?
Replace deprecated usage of ThreadPoolTaskSupport with
ExecutionContextTaskSupport and incidentally update the comment to indicate
that the number of concurrent objects is bounded by the threadpool size or 8
whichever is larger (updating the documentation to match code).
## How was the this patch tested?
unit tests, streaming/testOnly
org.apache.spark.streaming.util.WriteAheadLogUtilsSuite
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/holdenk/spark
SPARK-13398-move-away-from-ThreadPoolTaskSupport
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11287.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11287
----
commit 68df46a1093132ad3d5eef3e7a3d669105083236
Author: Holden Karau <[email protected]>
Date: 2016-02-21T07:08:45Z
Change FileWriteAheadLogger to not depend on deprecated ThreadPoolContext
commit 9991ebce07b6fabe122719ba1c4690e733297b18
Author: Holden Karau <[email protected]>
Date: 2016-02-21T07:13:40Z
Remove now unused import
commit f2e6a25ae2581e9b6cc43950c1302c26a8602c2a
Author: Holden Karau <[email protected]>
Date: 2016-02-21T07:19:27Z
Update the comment to point out if the thread pool is smaller than 8, that
is the number of objects kept in memory.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
