GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/12381
[WIP] Refactor MemoryManager internals to simplify code (open only for
testing / self-review now)
This PR refactors several parts of the MemoryManager internals in order to
simplify things so that I can address a lock-contention issue in a followup
patch.
Full PR description to follow later; opening now to get early test feedback
from Jenkins.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark SPARK-3000-take-3
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12381.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12381
----
commit 43f1ee8fe1599c614ca64a3e5c1648f70a34a7c5
Author: Josh Rosen <[email protected]>
Date: 2016-03-31T23:11:15Z
WIP
commit 47943c68208ba54cb8dce8f3d59ce507ed943531
Author: Josh Rosen <[email protected]>
Date: 2016-03-31T23:16:43Z
Merge remote-tracking branch 'origin/master' into SPARK-3000-take-3
commit cd2b8d50ae7a149b08af819e7dbd6ce20c461d3e
Author: Josh Rosen <[email protected]>
Date: 2016-04-01T00:49:21Z
Remove MemoryPool.
commit 3f68f7d42450aac8c82473549721eff82840084d
Author: Josh Rosen <[email protected]>
Date: 2016-04-01T01:47:17Z
WIP.
commit ca69ffc0b2d4f6966d4447b9b2839462bb88bffa
Author: Josh Rosen <[email protected]>
Date: 2016-04-01T21:20:46Z
Part two of major memory manager cleanup; now compiles and passes most
tests.
commit 135edd4aca7bbc3f56c29023afb237af605c83e1
Author: Josh Rosen <[email protected]>
Date: 2016-04-14T01:36:59Z
Deduplication.
commit 45c806e61bed2d61ff964a5688b1aeccc63d556d
Author: Josh Rosen <[email protected]>
Date: 2016-04-14T01:39:26Z
Merge remote-tracking branch 'origin/master' into SPARK-3000-take-3
commit 8a6398d6a01e8316e73bc4be73db4e6184960ee9
Author: Josh Rosen <[email protected]>
Date: 2016-04-14T01:57:40Z
Update diagrams in package docs.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
