Thanks Cheng. Tried it out and saw the InMemoryColumnarTableScan word in the
physical plan.
From: Cheng Lian [mailto:lian.cs@gmail.com]
Sent: Friday, December 12, 2014 11:37 PM
To: Judy Nash; user@spark.apache.org
Subject: Re: Spark SQL API Doc & IsCached as SQL command
There isn’t a
There isn’t a SQL statement that directly maps |SQLContext.isCached|,
but you can use |EXPLAIN EXTENDED| to check whether the underlying
physical plan is a |InMemoryColumnarTableScan|.
On 12/13/14 7:14 AM, Judy Nash wrote:
Hello,
Few questions on Spark SQL:
1)Does Spark SQL support equivale
http://spark.apache.org/docs/latest/sql-programming-guide.html#caching-data-in-memory
On Fri, Dec 12, 2014 at 3:14 PM, Judy Nash
wrote:
>
> Hello,
>
>
>
> Few questions on Spark SQL:
>
>
>
> 1) Does Spark SQL support equivalent SQL Query for Scala command:
> IsCached() ?
>
>
>
> 2) Is
Hello,
Few questions on Spark SQL:
1) Does Spark SQL support equivalent SQL Query for Scala command:
IsCached() ?
2) Is there a documentation spec I can reference for question like this?
Closest doc I can find is this one:
https://spark.apache.org/docs/1.1.0/sql-programming-guid