Hi Chris, thanks for the answer. I already had those configured:
task.checkpoint.factory= org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory task.checkpoint.system=kafka task.checkpoint.replication.factor=1 task.window.ms=5000 task.commit.ms=5000 task.checkpoint.failure.retry.ms=5000 - Claudio Martins Head of Engineering and User Experience MobileAware USA Inc. / www.mobileaware.com office: +1 617 986 5060 / mobile: +1 617 480 5288 linkedin: www.linkedin.com/in/martinsclaudio On Thu, Apr 17, 2014 at 2:15 PM, Chris Riccomini <[email protected]>wrote: > Hey Claudio, > > It looks like you're using the old configs from Samza 0.6.0. > Unfortunately, our docs have not yet been updated to reflect the new > configs for 0.7.0. There is a JIRA open for this, though: > > https://issues.apache.org/jira/browse/SAMZA-165 > > To enable checkpointing, you'll need to set: > > task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointMa > nagerFactory > # assume we have a system defined in the config called "kafka" > task.checkpoint.system=kafka > # can't be higher than the number of brokers in your Kafka grid, > # but should usually be more than one if you have more than one > # broker in your Kafka grid. > task.checkpoint.replication.factor=1 > > > Cheers, > Chris > > On 4/16/14 3:03 PM, "Claudio Martins" <[email protected]> wrote: > > >Hi guys, > > > >I'm having a hard time trying to figure out why my Samza job does not > >start > >processing Kafka messages from the last checkpoint. > > > >I have the task configured as > > > >systems.kafka.consumer.auto.offset.reset=smallest > >streams.topic-name.consumer.reset.offset=false > > > >However, when the job runs it doesn't start processing anything from the > >current offset, just the upcoming messages. > > > >I stop the job, load some messages into the topic and start the job again. > >Nothing happens, just the new messages are processed. > > > >Is there anything I am missing here? > > > >I do not want to start processing from the beginning of the topic, just to > >make it clear. I want to process from the last checkpoint. > > > > > >Thanks, > > > >- Claudio Martins > >linkedin: www.linkedin.com/in/martinsclaudio > >
