RE: Using bootstrap streams

2014-02-13 Thread Garry Turkington
13 To: dev@samza.incubator.apache.org Subject: Re: Using bootstrap streams Hey Garry, SAMZA-145 is merged in. Want to give stuff a shot with the latest patch? Thanks for your patience. :) Cheers, Chris On 2/12/14 6:28 PM, "Chris Riccomini" wrote: >Hey Garry, > >Yep, this is

Re: Using bootstrap streams

2014-02-12 Thread Chris Riccomini
ser [INFO] Building default chooser with: useBatching=false, >>useBootstrapping=false, usePriority=false >> >>Thanks for the help with this, hugely appreciated! >> >>Garry >> >> >>-Original Message- >>From: Chris Riccomini [mailto:criccom...@linkedin.

Re: Using bootstrap streams

2014-02-12 Thread Chris Riccomini
Building default chooser with: useBatching=false, >useBootstrapping=false, usePriority=false > >Thanks for the help with this, hugely appreciated! > >Garry > > >-Original Message- >From: Chris Riccomini [mailto:criccom...@linkedin.com] >Sent: 12 February 2014 22:0

RE: Using bootstrap streams

2014-02-12 Thread Garry Turkington
eBatching=false, useBootstrapping=false, usePriority=false Thanks for the help with this, hugely appreciated! Garry -Original Message- From: Chris Riccomini [mailto:criccom...@linkedin.com] Sent: 12 February 2014 22:07 To: dev@samza.incubator.apache.org Subject: Re: Using bootstrap str

Re: Using bootstrap streams

2014-02-12 Thread Chris Riccomini
2/14 10:44 AM, "Garry Turkington" >>wrote: >> >>>Hi Chris, >>> >>>Sorry for the wrong log file! >>> >>>Samza container log is at: >>>http://pastebin.com/D5bAJd7U >>> >>>I do notice that it mentions ret

Re: Using bootstrap streams

2014-02-12 Thread Chris Riccomini
pastebin.com/D5bAJd7U >> >>I do notice that it mentions returning the highest offset for the >>supposedly bootstrapped streams which I presume shouldn't be happening. >> >>Thanks, >>Garry >> >>-Original Message- >>From: Chris Riccomini [mail

Re: Using bootstrap streams

2014-02-12 Thread Chris Riccomini
gt; >-Original Message- >From: Chris Riccomini [mailto:criccom...@linkedin.com] >Sent: 12 February 2014 17:42 >To: dev@samza.incubator.apache.org >Subject: Re: Using bootstrap streams > >Hey Garry, > >So far, everything looks normal. > >The container you log you s

RE: Using bootstrap streams

2014-02-12 Thread Garry Turkington
Chris Riccomini [mailto:criccom...@linkedin.com] Sent: 12 February 2014 17:42 To: dev@samza.incubator.apache.org Subject: Re: Using bootstrap streams Hey Garry, So far, everything looks normal. The container you log you sent me actually appears to be the output of the run-job.sh command. Since y

Re: Using bootstrap streams

2014-02-12 Thread Chris Riccomini
o running the job -- and confirmed the data is in the Kafka stream >via kafka-console-consumer.sh with the --from-beginning option. > >Thanks for any input! >Garry > >-Original Message- >From: Chris Riccomini [mailto:criccom...@linkedin.com] >Sent: 10 February 20

RE: Using bootstrap streams

2014-02-11 Thread Garry Turkington
is in the Kafka stream via kafka-console-consumer.sh with the --from-beginning option. Thanks for any input! Garry -Original Message- From: Chris Riccomini [mailto:criccom...@linkedin.com] Sent: 10 February 2014 23:25 To: dev@samza.incubator.apache.org Subject: Re: Using bootstrap st

Re: Using bootstrap streams

2014-02-10 Thread Chris Riccomini
Hey Garry, It sounds like your understanding of bootstrap streams is correct. Bootstrap stream messages will be delivered to the process() method just like any other. The only difference is you're supposed to get all of them from 0-lastOffset before you get any messages from non-bootstrap streams