GitHub user nongli opened a pull request:
https://github.com/apache/spark/pull/10068
[SPARK-12030] Fix Platform.copyMemory to handle overlapping regions.
This bug was exposed as memory corruption in Timsort which uses copyMemory
to copy
large regions that can overlap. The prior implementation did not handle
this case
half the time and always copied forward, resulting in the data being
corrupt.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nongli/spark spark-12030
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10068.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10068
----
commit ebf4d10fcfcf956af2edf7e033b8da609c32eb44
Author: Nong Li <[email protected]>
Date: 2015-12-01T17:28:05Z
[SPARK-12030] Fix Platform.copyMemory to handle overlapping regions.
This bug was exposed as memory corruption in Timsort which uses copyMemory
to copy
large regions that can overlap. The prior implementation did not handle
this case
half the time and always copied forward, resulting in the data being
corrupt.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
