Re: Under-replicated Partitions while rolling Kafka nodes in AWS

2017-01-09 Thread Jack Lund
On Thu, Jan 5, 2017 at 4:32 PM James Cheng wrote: > > FYI, zookeeper 3.4.8 fixes the issue where you have to restart zookeeper > nodes when their DNS mapping changes. I'm not sure how it affects > restarting kafka though, when the zookeeper DNS changes. > > https://zookeeper.apache.org/doc/r3.4.8

Under-replicated Partitions while rolling Kafka nodes in AWS

2017-01-05 Thread Jack Lund
as and the leadership election process. This is causing us some pain because it means that we get pages whenever we roll out changes to Zookeeper. Does anybody have any ideas why this would be happening, and how we can avoid it? Thanks. -Jack Lund Braintree Payments

Re: Resetting the Offset of a Kafka Sink Connector

2016-06-05 Thread Jack Lund
ld. > > -Ewen > > On Tue, May 31, 2016 at 9:47 AM, Jack Lund < > jack.l...@braintreepayments.com> > wrote: > > > Yes, the one that the SinkConnector uses is the WorkerSinkTaskContext, > but, > > unfortunately, it creates it and uses it internally, but doesn&#

Re: Resetting the Offset of a Kafka Sink Connector

2016-05-31 Thread Jack Lund
wrote: > Have you tried either of the SinkTaskContext.offset() methods ? > > > https://kafka.apache.org/0100/javadoc/org/apache/kafka/connect/sink/SinkTaskContext.html > > On Tue, May 31, 2016 at 8:43 AM, Jack Lund < > jack.l...@braintreepayments.com> > wrote: > >

Resetting the Offset of a Kafka Sink Connector

2016-05-31 Thread Jack Lund
ter has accessors to reset the offsets with. Without those, I'm not sure what the purpose of the rewind method is, since it doesn't seem to be possible to set the offsets at all. Is this by design? Thanks. -Jack Lund Braintree Payment Systems

Re: Fetching Offsets Stored in Kafka in 0.9.0

2015-11-24 Thread Jack Lund
u to replay events from any > point. > > You can also manually commit a specific offset. > > > > Gwen > > > > On Tue, Nov 24, 2015 at 2:11 PM, Jack Lund < > > jack.l...@braintreepayments.com> > > wrote: > > > > > We’re running Kafka 0.9.0

Fetching Offsets Stored in Kafka in 0.9.0

2015-11-24 Thread Jack Lund
seem to be valid any more (for instance, kafka.javaapi.ConsumerMetadataRequest and Response don’t seem to exist any more). Is there any updated code snippets for fetching/committing offsets in Kafka? Thanks -Jack Lund Braintree Payments ​