Re: Upgrades of streaming jobs

2018-03-09 Thread Tathagata Das
the application and resubmit your application to the cluster). On Thu, Mar 8, 2018 at 12:11 PM, Georg Heiler <georg.kf.hei...@gmail.com> wrote: > Hi > > What is the state of spark structured streaming jobs and upgrades? > > Can checkpoints of version 1 be read by version 2

Upgrades of streaming jobs

2018-03-08 Thread Georg Heiler
Hi What is the state of spark structured streaming jobs and upgrades? Can checkpoints of version 1 be read by version 2 of a job? Is downtime required to upgrade the job? Thanks