GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/22292
[SPARK-25286][CORE] Removing the dangerous parmap
## What changes were proposed in this pull request?
I propose to remove the `parmap` method which accepts an execution context
as a parameter. The method should be removed to eliminate any deadlocks that
can occur if `parmap` is called recursively on thread pools restricted by size.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/MaxGekk/spark-1 remove-overloaded-parmap
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22292.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22292
----
commit 7fbd7b44edec74d07356148c349c1a6fbe163e1b
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-08-30T20:43:22Z
Revert "Porting UnionRDD on parmap"
This reverts commit 72cdfeb765cda13ab03ed8515a83fa24657894ac.
commit 6fd4c0099c85df240ef7fb9d915f0b20c06b0040
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-08-30T20:48:05Z
Removing potentially dangerous method
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
