Hey Claudio, Hmm. Could you post your logs somewhere where we can have a look? The logs should say whether the checkpoint is used or not, and also provide insight into why they might not be.
Cheers, Chris On 4/17/14 11:19 AM, "Claudio Martins" <[email protected]> wrote: >Hi Chris, thanks for the answer. > >I already had those configured: > >task.checkpoint.factory= >org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory > >task.checkpoint.system=kafka > >task.checkpoint.replication.factor=1 > >task.window.ms=5000 > >task.commit.ms=5000 > >task.checkpoint.failure.retry.ms=5000 > >- Claudio Martins >Head of Engineering and User Experience >MobileAware USA Inc. / www.mobileaware.com >office: +1 617 986 5060 / mobile: +1 617 480 5288 >linkedin: www.linkedin.com/in/martinsclaudio > > >On Thu, Apr 17, 2014 at 2:15 PM, Chris Riccomini ><[email protected]>wrote: > >> Hey Claudio, >> >> It looks like you're using the old configs from Samza 0.6.0. >> Unfortunately, our docs have not yet been updated to reflect the new >> configs for 0.7.0. There is a JIRA open for this, though: >> >> https://issues.apache.org/jira/browse/SAMZA-165 >> >> To enable checkpointing, you'll need to set: >> >> >>task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpoint >>Ma >> nagerFactory >> # assume we have a system defined in the config called "kafka" >> task.checkpoint.system=kafka >> # can't be higher than the number of brokers in your Kafka grid, >> # but should usually be more than one if you have more than one >> # broker in your Kafka grid. >> task.checkpoint.replication.factor=1 >> >> >> Cheers, >> Chris >> >> On 4/16/14 3:03 PM, "Claudio Martins" <[email protected]> wrote: >> >> >Hi guys, >> > >> >I'm having a hard time trying to figure out why my Samza job does not >> >start >> >processing Kafka messages from the last checkpoint. >> > >> >I have the task configured as >> > >> >systems.kafka.consumer.auto.offset.reset=smallest >> >streams.topic-name.consumer.reset.offset=false >> > >> >However, when the job runs it doesn't start processing anything from >>the >> >current offset, just the upcoming messages. >> > >> >I stop the job, load some messages into the topic and start the job >>again. >> >Nothing happens, just the new messages are processed. >> > >> >Is there anything I am missing here? >> > >> >I do not want to start processing from the beginning of the topic, >>just to >> >make it clear. I want to process from the last checkpoint. >> > >> > >> >Thanks, >> > >> >- Claudio Martins >> >linkedin: www.linkedin.com/in/martinsclaudio >> >>
