Re: mapWithState: remove key

That makes sense. Thanks for your quick response. On Fri, Jan 29, 2016 at 7:01 PM, Shixiong(Ryan) Zhu wrote: > 1. To remove a state, you need to call "state.remove()". If you return a > None in the function, it just means don't output it as the DStream's > output, but

Re: mapWithState: remove key

1. To remove a state, you need to call "state.remove()". If you return a None in the function, it just means don't output it as the DStream's output, but the state won't be removed if you don't call "state.remove()". 2. For NoSuchElementException, here is the doc for "State.get": /** * Get

mapWithState: remove key

Hi, >From the signature of the "mapWithState" method I infer that by returning a "None.type" (in Scala) the key is removed from the state. Is that so? Sorry if it is in the docs, but it wasn't entirely clear to me. I'm chaining operations and calling "mapWithState" twice (one to consolidate,