That makes sense. Thanks for your quick response.
On Fri, Jan 29, 2016 at 7:01 PM, Shixiong(Ryan) Zhu wrote:
> 1. To remove a state, you need to call "state.remove()". If you return a
> None in the function, it just means don't output it as the DStream's
> output, but the state won't be removed
1. To remove a state, you need to call "state.remove()". If you return a
None in the function, it just means don't output it as the DStream's
output, but the state won't be removed if you don't call "state.remove()".
2. For NoSuchElementException, here is the doc for "State.get":
/**
* Get t
Hi,
>From the signature of the "mapWithState" method I infer that by returning a
"None.type" (in Scala) the key is removed from the state. Is that so? Sorry
if it is in the docs, but it wasn't entirely clear to me.
I'm chaining operations and calling "mapWithState" twice (one to
consolidate, then