Yup, it only returns each value once.
Matei
On Mar 17, 2014, at 1:14 PM, Adrian Mocanu wrote:
> Hi
> Quick question here,
> I know that .foreach is not idempotent. I am wondering if collect() is
> idempotent? Meaning that once I’ve collect()-ed if spark node crashes I can’t
> get the same va
Hi
Quick question here,
I know that .foreach is not idempotent. I am wondering if collect() is
idempotent? Meaning that once I've collect()-ed if spark node crashes I can't
get the same values from the stream ever again.
Thanks
-Adrian
