As of now (Spark 2.2), Structured Streaming does checkpoint of the state data synchronously in every trigger. But the checkpointing is incremental, so it wont be writing all your state every time. And we will be making this asynchronous soon.
On Fri, Apr 7, 2017 at 3:19 AM, kant kodali <kanth...@gmail.com> wrote: > Hi All, > > Is checkpointing in Spark Streaming Synchronous or Asynchronous ? other > words can spark continue processing the stream while checkpointing? > > Thanks! >
