Hi All,

I am using a Receiver based approach. And I understand that spark streaming
API's will convert the received data from receiver into blocks and these
blocks that are in memory are also stored in WAL if one enables it. my
upstream source which is not Kafka can also replay by which I mean if I
don't send an ack to my upstream source it will resend it so I don't have
to write the received data to WAL however I still need to enable WAL
correct? because there are blocks that are in memory that needs to written
to WAL so they can be recovered later.

Thanks,
kant

Reply via email to