Re: Spark Streaming - Collecting RDDs into array in the driver program

2015-02-25 Thread Thanigai Vellore
efore the foreachrdd stage is executed. Is that possible? On Feb 25, 2015 5:41 PM, "Tathagata Das" wrote: > You are just setting up the computation here using foreacRDD. You have not > even run the streaming context to get any data. > > > On Wed, Feb 25, 201

Spark Streaming - Collecting RDDs into array in the driver program

2015-02-25 Thread Thanigai Vellore
I have this function in the driver program which collects the result from rdds (in a stream) into an array and return. However, even though the RDDs (in the dstream) have data, the function is returning an empty array...What am I doing wrong? I can print the RDD values inside the foreachRDD call b