Re: Per task/topic checkpoint?

2017-10-28 Thread Jagadish Venkatraman
In Samza, the logical unit of processing (and hence, checkpointing) is a task. Hence, you cannot selectively checkpoint SSPs within a task. However, you can configure how you group your SSPs into tasks by choosing a Grouper. If you want to control checkpointing at the granularity of an SSP, then

Per task/topic checkpoint?

2017-10-28 Thread Gaurav Agarwal
Hi All, If I had Samza Tasks that were consuming message from multiple topics, how would checkpoint/commit work in that case? On calling taskCordinator.commit(), would current offset of all topics be saved for the caller task (only the partitions assigned to the caller task)? Is there a way to