Kaushal Prajapati created SPARK-19289:
-----------------------------------------
Summary: UnCache Dataset using Name
Key: SPARK-19289
URL: https://issues.apache.org/jira/browse/SPARK-19289
Project: Spark
Issue Type: Wish
Components: Spark Core, SQL
Affects Versions: 2.1.0
Reporter: Kaushal Prajapati
Priority: Minor
We can Cache and Uncache any table using its name in Spark Sql.
{code}
df.createTempView("myTable")
sqlContext.cacheTable("myTable")
sqlContext.uncacheTable("myTable")
{code}
Likewise if it is possible to have some kind of uniqueness for names in
DataSets and an abstraction like the same that we have for tables. It would be
very useful
{code}
scala> val df = sc.range(1,1000).toDF
df: org.apache.spark.sql.DataFrame = [value: bigint]
scala> df.setName("MyDataset")
res0: df.type = MyDataset
scala> df.cache
res1: df.type = MyDataset
sqlContext.getDataSet("MyDataset")
sqlContext.uncacheDataSet("MyDataset")
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
