Hi gurus,

I've added some debug output in my UnboundedReader and Checkpoint classes,
and noticed that the Dataflow Runner keeps encoding the checkpoint objects,
but never decode it, and never invoke the UnboundedReader.close() method in
my testing.

However, the Direct Runner will decode the checkpoint object just after
encode it,  and it will also invoke the UnboundedReader.close() method and
start new reader every now and then.

The google Dataflow will be the future production environment, so I'd like
to know when will the Dataflow Runner invoke the UnboundedReader.close()
method and decode the checkpoint?

Thanks in advance!

Island Chen

Reply via email to