If you are using kafka direct connect api it might be committing offset back to kafka itself
בתאריך יום ה׳, 7 ביוני 2018, 4:10, מאת licl <lichenglin0...@126.com>: > I met the same issue and I have try to delete the checkpoint dir before the > job , > > But spark seems can read the correct offset even though after the > checkpoint dir is deleted , > > I don't know how spark do this without checkpoint's metadata. > > > > -- > Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
