[
https://issues.apache.org/jira/browse/SPARK-24521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-24521.
-----------------------------
Resolution: Fixed
Fix Version/s: 2.4.0
2.3.2
> Fix ineffective test in CachedTableSuite
> ----------------------------------------
>
> Key: SPARK-24521
> URL: https://issues.apache.org/jira/browse/SPARK-24521
> Project: Spark
> Issue Type: Test
> Components: SQL
> Affects Versions: 2.3.1
> Reporter: Li Jin
> Assignee: Li Jin
> Priority: Minor
> Fix For: 2.3.2, 2.4.0
>
>
> test("withColumn doesn't invalidate cached dataframe") in CachedTableSuite
> doesn't not work because:
> The UDF is executed and test count incremented when "df.cache()" is called
> and the subsequent "df.collect()" has no effect on the test result.
> link:
> https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala#L86
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
