GitHub user viirya opened a pull request:
https://github.com/apache/spark/pull/19772
[SPARK-22538][SQL] SQLTransformer should not unpersist possibly cached
input dataset
## What changes were proposed in this pull request?
`SQLTransformer.transform` unpersists input dataset when dropping temporary
view. We should not change input dataset's cache status.
## How was this patch tested?
Added test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/viirya/spark-1 SPARK-22538
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19772.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19772
----
commit a96a9d3bc0ee10eac9fe78dbf6b86e8952af4912
Author: Liang-Chi Hsieh <[email protected]>
Date: 2017-11-17T04:34:46Z
SQLTransformer should not unpersist possibly cached input dataset.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
