Yin Huai created SPARK-5881:
-------------------------------
Summary: RDD remains cached after the table gets overridden by
"CACHE TABLE"
Key: SPARK-5881
URL: https://issues.apache.org/jira/browse/SPARK-5881
Project: Spark
Issue Type: Bug
Components: SQL
Reporter: Yin Huai
Priority: Blocker
{code}
val rdd = sc.parallelize((1 to 10).map(i => s"""{"a":$i, "b":"str${i}"}"""))
sqlContext.jsonRDD(rdd).registerTempTable("jt")
sqlContext.sql("CACHE TABLE foo AS SELECT * FROM jt")
sqlContext.sql("CACHE TABLE foo AS SELECT * FROM jt")
{code}
After the second CACHE TABLE command, the RDD for the first table still remains
in the cache.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
