Sean, On Wed, Mar 11, 2015 at 7:43 PM, Tobias Pfeiffer <t...@preferred.jp> wrote: > > it seems like I am unable to shut down my StreamingContext properly, both > in local[n] and yarn-cluster mode. In addition, (only) in yarn-cluster > mode, subsequent use of a new StreamingContext will raise > an InvalidActorNameException. >
I was wondering if this is related to your question on spark-dev http://tinyurl.com/q5cd5px Did you get any additional insight into this issue? In my case the processing of the first batch completes, but I don't know if there is anything wrong with the checkpoints? When I look to the corresponding checkpoint directory in HDFS, it doesn't seem like all state RDDs are persisted there, just a subset. Any ideas? Thanks Tobias
