Re: flushing changelog & checkpointing

2016-07-11 Thread Jacob Maes
From: Yi Pan [mailto:nickpa...@gmail.com] > Sent: Wednesday, July 06, 2016 1:10 PM > To: dev@samza.apache.org > Subject: Re: flushing changelog & checkpointing > > Hi, Buvana, > > Please see answers below. > > On Tue, Jul 5, 2016 at 11:47 AM, Ramanan, Buvana (Nok

RE: flushing changelog & checkpointing

2016-07-06 Thread Ramanan, Buvana (Nokia - US)
PM To: dev@samza.apache.org Subject: Re: flushing changelog & checkpointing Hi, Buvana, Please see answers below. On Tue, Jul 5, 2016 at 11:47 AM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia-bell-labs.com> wrote: > > Does this mean that all writes to the disk for stat

Re: flushing changelog & checkpointing

2016-07-06 Thread Yi Pan
Hi, Buvana, Please see answers below. On Tue, Jul 5, 2016 at 11:47 AM, Ramanan, Buvana (Nokia - US) < buvana.rama...@nokia-bell-labs.com> wrote: > > Does this mean that all writes to the disk for state store purposes will > be done at the checkpointing time (which is also the time Samza

flushing changelog & checkpointing

2016-07-06 Thread Ramanan, Buvana (Nokia - US)
Hello, I am looking for more details on the point in processing cycle at which the state store in Samza is written to disk. I noted the following statement in Samza Stateful Processing section: "Samza includes an additional in-memory caching layer in front of RocksDB, which avoids the cost of