Re: WorkerSinkTask not committing offsets (potential bug)

2017-09-08 Thread Shrijeet Paliwal
te causing all > subsequent commits to be ignored (see logs above). Relevant code snippets > are: > > private void doCommit(Map offsets, > boolean closing, final int seqno) { >log.info("{} Committing offsets", this); >if (closing)

WorkerSinkTask not committing offsets (potential bug)

2017-09-07 Thread Shrijeet Paliwal
all subsequent commits to be ignored (see logs above). Relevant code snippets are: private void doCommit(Map offsets, boolean closing, final int seqno) { log.info("{} Committing offsets", this); if (closing) { doCommitSync(offsets, seqno); } else {

Re: Error while committing offsets. java.io.EOFException: Received -1 when reading from channel, socket has likely been closed.

2017-02-13 Thread Upendra Yadav
_hadoop_tables_172.20.6.248-1486730164723-67176e62], > Error while committing offsets. > java.io.EOFException: Received -1 when reading from channel, socket has > likely been closed. > at kafka.utils.Utils$.read(Utils.scala:381) > at kafka.network.BoundedByteBufferRe

Error while committing offsets. java.io.EOFException: Received -1 when reading from channel, socket has likely been closed.

2017-02-13 Thread Upendra Yadav
tions that I need to take care to fix this. ERROR kafka.consumer.ZookeeperConsumerConnector: [zohocrm_172_20_2_23_hadoop_tables_172.20.6.248-1486730164723-67176e62], Error while committing offsets. java.io.EOFException: Received -1 when reading from channel, socket has likely been closed.

Re: Kafka Connect Consumer throwing ILLEGAL_GENERATION when committing offsets and going into re-balance state

2017-01-25 Thread Srikrishna Alla
; fix this issue >> >> 2017-01-20 17:22:21 INFO WorkerSinkTask : 187 - >> WorkerSinkTask{id=jdbc-sink-connector-0} Committing offsets >> 2017-01-20 17:22:21 DEBUG KafkaConsumer : 1023 - Committing offsets: >> {monitorAlert-2=OffsetAndMetadata{offset=12832, metadata='

Re: Kafka Connect Consumer throwing ILLEGAL_GENERATION when committing offsets and going into re-balance state

2017-01-24 Thread Srikrishna Alla
periodically throwing an error when saving offsets and then > going into group rebalance state. Please let me know what can be done to > fix this issue > > 2017-01-20 17:22:21 INFO WorkerSinkTask : 187 - > WorkerSinkTask{id=jdbc-sink-connector-0} Committing offsets > 2017-01-2

Kafka Connect Consumer throwing ILLEGAL_GENERATION when committing offsets and going into re-balance state

2017-01-23 Thread Srikrishna Alla
- WorkerSinkTask{id=jdbc-sink-connector-0} Committing offsets 2017-01-20 17:22:21 DEBUG KafkaConsumer : 1023 - Committing offsets: {monitorAlert-2=OffsetAndMetadata{offset=12832, metadata=''}, monitorAlert-0=OffsetAndMetadata{offset=12755, metadata=''}, monitorAlert-1=OffsetAndMetadata{of

Re: Error ILLEGAL_GENERATION occurred while committing offsets for group

2016-07-23 Thread Ewen Cheslack-Postava
On Tue, Jul 12, 2016 at 10:35 AM, Paramesh Nc wrote: > Hi , > > I am getting the below error messages when consuming the records from the > kafka topic . > > o.a.k.c.c.internals.ConsumerCoordinator : Error ILLEGAL_GENERATION > occurred while committing offsets for group test

Error ILLEGAL_GENERATION occurred while committing offsets for group

2016-07-12 Thread Paramesh Nc
Hi , I am getting the below error messages when consuming the records from the kafka topic . o.a.k.c.c.internals.ConsumerCoordinator : Error ILLEGAL_GENERATION occurred while committing offsets for group test-group. 2016-07-11 22:56:50.314 ERROR 8699 --- [ Thread

Deadlock when committing offsets

2016-04-01 Thread Oleg Zhurakousky
Hi Was wondering what could be the causes of what appears to be an intermittent deadlock when calling Consumer.commitOffsets(..) Below are the few relevant thread dump segments: "StandardProcessScheduler Thread-7" Id=115 BLOCKED on java.lang.Object@2baae51 at kafka.consumer.ZookeeperCo

RE: committing offsets

2015-09-22 Thread Joris Peeters
Yep, that was it ... Everything works now. And the only thing that didn't, earlier, was my head. Thanks all! -Joris. -Original Message- From: noah [mailto:iamn...@gmail.com] Sent: 22 September 2015 12:17 To: users@kafka.apache.org Subject: Re: committing offsets If you are usin

Re: committing offsets

2015-09-22 Thread noah
gt; -Original Message- > From: tao xiao [mailto:xiaotao...@gmail.com] > Sent: 22 September 2015 10:51 > To: users@kafka.apache.org > Subject: Re: committing offsets > > 0.8.2.1 already supports Kafka offset storage. You can set > offsets.storage=kafka in consumer propert

RE: committing offsets

2015-09-22 Thread Joris Peeters
'java -jar ...' with no logging config). -J -Original Message- From: tao xiao [mailto:xiaotao...@gmail.com] Sent: 22 September 2015 10:51 To: users@kafka.apache.org Subject: Re: committing offsets 0.8.2.1 already supports Kafka offset storage. You can set offsets.storage=kafka in

Re: committing offsets

2015-09-22 Thread tao xiao
/kafka/consumer/ZookeeperConsumerConnector.scala#L308 On Tue, 22 Sep 2015 at 17:44 Joris Peeters wrote: > I'm trying to set up a kafka consumer (in Java) that uses the new approach > of committing offsets (i.e. in the __consumer_offsets topic etc, rather > than through zookeeper). &g

committing offsets

2015-09-22 Thread Joris Peeters
I'm trying to set up a kafka consumer (in Java) that uses the new approach of committing offsets (i.e. in the __consumer_offsets topic etc, rather than through zookeeper). Am I correct in believing that the current version (we're using kafka 8.2.1) does not expose this through the