GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/2688
[SPARK-3825] Log more detail when unrolling a block fails
Before:
```
14/10/06 16:45:42 WARN CacheManager: Not enough space to cache partition
rdd_0_2 in memory! Free memory is 481861527 bytes.
```
After:
```
14/10/06 21:40:36 WARN MemoryStore: Not enough space to store partition
rdd_0_2 in memory (unrolled 68.8 MB so far)!
14/10/06 21:40:36 INFO MemoryStore: Max memory is 459.5 MB, of which 1088.0
B is occupied by blocks and 445.1 MB is reserved for unrolling blocks shared
across 8 thread(s). Total free memory left is 14.5 MB.
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark cache-log-message
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/2688.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2688
----
commit 39a0c287fc450c03a7fd780e6c0197d4ba622796
Author: Andrew Or <[email protected]>
Date: 2014-10-07T04:41:40Z
Log more detail when unrolling a block fails
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
