Re: Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-25 Thread Praveen Devarao
Cool!! Thanks for the clarification Mike. Thanking You - Praveen Devarao Spark Technology Centre IBM India Software Labs - "Co

Re: Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-24 Thread Praveen Devarao
anking You ----- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try again&quo

Do transformation functions on RDD invoke a Job [sc.runJob]?

2016-04-24 Thread Praveen Devarao
invoke a Job, though they are transformations and not actions? I am on Spark 1.6 Thanking You --------- Praveen Devarao Spark Technology C

Re: Spark structured streaming

2016-03-08 Thread Praveen Devarao
- Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will

Spark structured streaming

2016-03-08 Thread Praveen Devarao
rom a consumability angle. Thanking You - Praveen Devarao Spark Technology Centre IBM India Software Labs - "Courage doesn't always

Guidelines for writing SPARK packages

2016-02-01 Thread Praveen Devarao
point to docs or links on the above? Thanking You Praveen Devarao

IDE for spark development

2016-01-13 Thread Praveen Devarao
Hi, What is the best IDE for spark development? When I say development I would like to make changes in SPARK core and be able to contribute back. I know this question is been asked many times but I don't see a convincing answer anywhere. I use intelliJ but getting the environmen