You don't need write ahead logs for direct stream. On Tue, May 2, 2017 at 11:32 AM, kant kodali <kanth...@gmail.com> wrote: > Hi All, > > I need some fault tolerance for my stateful computations and I am wondering > why we need to enable writeAheadLogs for DirectStream like Kafka (for > Indirect stream it makes sense). In case of driver failure DirectStream such > as Kafka can pull the messages again from the last committed offset right? > > Thanks!
--------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
