Hi DaPeng, The parameter "checkpoint.dir" in spark configuration just works for spark streaming calculation in streaming mode, the directory will hold the spark checkpoint data for failure recovery of spark streaming applications.
Thanks, Lionel On Thu, Jan 17, 2019 at 11:42 AM 大鹏 <[email protected]> wrote: > What's the purpose of the checkpoint.dir parameter in spark configuration > file? > > > >
