Chao Sun created SPARK-34076:
--------------------------------
Summary: SQLContext.dropTempTable fails if cache is non-empty
Key: SPARK-34076
URL: https://issues.apache.org/jira/browse/SPARK-34076
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.0.1
Reporter: Chao Sun
{{SQLContext.dropTempView}} calls {{CatalogImpl.dropTempView}} which is
implemented as following:
{code}
override def dropTempView(viewName: String): Boolean = {
sparkSession.sessionState.catalog.getTempView(viewName).exists { viewDef =>
sparkSession.sharedState.cacheManager.uncacheQuery(
sparkSession, viewDef, cascade = false)
sessionCatalog.dropTempView(viewName)
}
}
{code}
Here, the logical plan {{viewDef}} is not resolved, and when passing to
{{uncacheQuery}}, it could fail at {{sameResult}} call, when canonicalized plan
is compared. The error message looks like:
{code}
Invalid call to qualifier on unresolved object, tree: 'key
{code}
This can be reproduced via:
{code}
test("XXX") {
val t = "t"
val v = "v"
withTable(t) {
withTempView(v) {
sql(s"CREATE TABLE $t AS SELECT * FROM src")
sql(s"CACHE TABLE $t")
sql(s"CREATE TEMPORARY VIEW $v AS SELECT key FROM src LIMIT 10")
}
}
}
{code}
through test.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
