GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/16667
[SPARK-18750][yarn] Avoid using "mapValues" when allocating containers.
That method is prone to stack overflows when the input map is really
large; instead, use plain "map". Also includes a unit tests that was
tested and caused stack overflows without the fix.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vanzin/spark SPARK-18750
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16667.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16667
----
commit 5d33e3e9e51de80c66233d8dc1fb4551e2c696b2
Author: Marcelo Vanzin <[email protected]>
Date: 2017-01-21T01:09:59Z
[SPARK-18750][yarn] Avoid using "mapValues" when allocating containers.
That method is prone to stack overflows when the input map is really
large; instead, use plain "map". Also includes a unit tests that was
tested and caused stack overflows without the fix.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
