Re: RDD generated on every query

2015-04-14 Thread Akhil Das
You can use a tachyon based storage for that and everytime the client
queries, you just get it from there.

Thanks
Best Regards

On Mon, Apr 6, 2015 at 6:01 PM, Siddharth Ubale siddharth.ub...@syncoms.com
 wrote:

  Hi ,



 In Spark Web Application the RDD is generating every time client is
 sending a query request. Is there any way where the RDD is compiled once
 and run query again and again on active SparkContext?



 Thanks,

 Siddharth Ubale,

 *Synchronized Communications *

 *#43, Velankani Tech Park, Block No. II, *

 *3rd Floor, Electronic City Phase I,*

 *Bangalore – 560 100*

 *Tel : +91 80 3202 4060*

 *Web:* *www.syncoms.com* http://www.syncoms.com/

 *[image: LogoNEWmohLARGE]*

 *London*|*Bangalore*|*Orlando*



 *we innovate, plan, execute, and transform the business​*





Re: RDD generated on every query

2015-04-14 Thread twinkle sachdeva
Hi,

If you have the same spark context, then you can cache the query result via
caching the table ( sqlContext.cacheTable(tableName) ).

Maybe you can have a look at OOyola server also.



On Tue, Apr 14, 2015 at 11:36 AM, Akhil Das ak...@sigmoidanalytics.com
wrote:

 You can use a tachyon based storage for that and everytime the client
 queries, you just get it from there.

 Thanks
 Best Regards

 On Mon, Apr 6, 2015 at 6:01 PM, Siddharth Ubale 
 siddharth.ub...@syncoms.com wrote:

  Hi ,



 In Spark Web Application the RDD is generating every time client is
 sending a query request. Is there any way where the RDD is compiled once
 and run query again and again on active SparkContext?



 Thanks,

 Siddharth Ubale,

 *Synchronized Communications *

 *#43, Velankani Tech Park, Block No. II, *

 *3rd Floor, Electronic City Phase I,*

 *Bangalore – 560 100*

 *Tel : +91 80 3202 4060*

 *Web:* *www.syncoms.com* http://www.syncoms.com/

 *[image: LogoNEWmohLARGE]*

 *London*|*Bangalore*|*Orlando*



 *we innovate, plan, execute, and transform the business​*