GitHub user robbinspg opened a pull request:
https://github.com/apache/spark/pull/13707
[SPARK-15822][SQL] avoid UTF8String references into freed pages
## What changes were proposed in this pull request?
In SMJ codegen we need to save copies of UTF8String values as the final
iterator.next() will free the underlying memory page.
## How was this patch tested?
Test application as described in 15822 now passes.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/robbinspg/spark-1 master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/13707.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #13707
----
commit d201034e628456b9640eb8483da849217aa80c92
Author: Pete Robbins <[email protected]>
Date: 2016-06-16T14:33:31Z
Create copy of UTF8String in SMJ
commit 1288f1e88f90b751cd0640864d7cc6cb5a9dfeca
Author: Pete Robbins <[email protected]>
Date: 2016-06-16T15:21:23Z
make copy() public
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
