[
https://issues.apache.org/jira/browse/SPARK-21512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097565#comment-16097565
]
Kazuaki Ishizaki edited comment on SPARK-21512 at 7/24/17 4:53 AM:
-------------------------------------------------------------------
When {{DatasetCacheSuite}} is executed, the following warning messages appear.
Unpersistent dataset is made persistent in the second test case {{"persist and
then rebind right encoder when join 2 datasets"}} after the first test case
{{"get storage level"}} made it persistent.
Thus, we run these test cases, the second case does not perform to make dataset
persistent. This is because in
When we run only the second case, it performs to make dataset persistent. It
is not good to change behavior of the second test suite. The first test case
should correctly make dataset unpersistent.
{code}
01:52:48.595 WARN org.apache.spark.sql.execution.CacheManager: Asked to cache
already cached data.
01:52:48.692 WARN org.apache.spark.sql.execution.CacheManager: Asked to cache
already cached data.
{code}
was (Author: kiszk):
When {DatasetCacheSuite} is executed, the following warning messages appear.
Unpersistent dataset is made persistent in the second test case {{"persist and
then rebind right encoder when join 2 datasets"}} after the first test case
{{"get storage level"}} made it persistent.
Thus, we run these test cases, the second case does not perform to make dataset
persistent. This is because in
When we run only the second case, it performs to make dataset persistent. It
is not good to change behavior of the second test suite. The first test case
should correctly make dataset unpersistent.
{code}
01:52:48.595 WARN org.apache.spark.sql.execution.CacheManager: Asked to cache
already cached data.
01:52:48.692 WARN org.apache.spark.sql.execution.CacheManager: Asked to cache
already cached data.
{code}
> DatasetCacheSuite needs to execute unpersistent after executing peristent
> -------------------------------------------------------------------------
>
> Key: SPARK-21512
> URL: https://issues.apache.org/jira/browse/SPARK-21512
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.3.0
> Reporter: Kazuaki Ishizaki
> Assignee: Kazuaki Ishizaki
> Fix For: 2.3.0
>
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
