Re: is collect exactly-once?

[Matei Zaharia]

Yup, it only returns each value once.

Matei

On Mar 17, 2014, at 1:14 PM, Adrian Mocanu  wrote:

> Hi
> Quick question here,
> I know that .foreach is not idempotent.  I am wondering if collect() is 
> idempotent? Meaning that once I’ve collect()-ed if spark node crashes I can’t 
> get the same values from the stream ever again.
>  
> Thanks
> -Adrian

is collect exactly-once?

[Adrian Mocanu]

Hi
Quick question here,
I know that .foreach is not idempotent.  I am wondering if collect() is 
idempotent? Meaning that once I've collect()-ed if spark node crashes I can't 
get the same values from the stream ever again.

Thanks
-Adrian