Kristian Kolding Foged-Ladefoged created KAFKA-7153:
-------------------------------------------------------
Summary: Kafka commits transaction twice due to LeaveGroup
Key: KAFKA-7153
URL: https://issues.apache.org/jira/browse/KAFKA-7153
Project: Kafka
Issue Type: Bug
Reporter: Kristian Kolding Foged-Ladefoged
I am using transaction in kafka. I have provided my consumer container with a
`ChainedKafkaTransactionManager` which consist of `JpaTransactionManager` and
`KafkaTransactionManager`.
I am trying to learn how transactions are affected when a consumer is stuck and
therefore send `LeaveGroup` and disables heartbeat thread.
I have set `max.poll.interval.ms` to 10 seconds.
I have not changed `session.timeout.ms`. It is 10 seconds per default.
I have two applications with one consumer each. Both consumers are
transactional. Consumer A is rigged to process for 30 seconds and Consumer B
process it within 1 second. Both consumers read from the same topic, which as 3
partitions.
1. Send a record to Kafka
2. Consumer A receives the record.
3. Consumer A starts to process the record.
4. Consumer A processing time exceed `max.poll.interval.ms`
5. Consumer A send LeaveGroup and heartbeat stops.
6. Kafka rebalances. All partitions are now assigned to Consumer B.
7. Consumer B receives the same record and process it.
8. Consumer B commits the transaction.
9. Consumer A has now finished processing(30 seconds).
10. Consumer A commits the transaction.
11. Kafka rebalances. Partitions are reassigned to both consumers.
The transaction is processed and committed twice. Both consumers should be
idempotent to ensure processing the same record have no consequences.
My hypothesis was that Consumer A would throw an exception due to LeaveGroup
and stopping the heartbeat. This is however not the case. I have tested this
with unique transaction IDs and transaction ID being identical in both
applications - same result.
Why does Consumer A commit the transaction after LeaveGroup has been sent?
*Log for Consumer A*
*2018-07-12 11:09:00.054 DEBUG [kafka-transaction-microservice-example,,,]
55757 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer :
Received: 1 records
2018-07-12 11:09:00.055 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Creating new
transaction with name [null]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
2018-07-12 11:09:00.056 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Transition from state
READY to IN_TRANSACTION
2018-07-12 11:09:00.056 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Created Kafka
transaction on producer [brave.kafka.clients.TracingProducer@77b619a8]
2018-07-12 11:09:00.057 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] l.a.BatchMessagingMessageListenerAdapter : Processing
[GenericMessage [payload=[data], headers=\{kafka_offset=[50],
kafka_consumer=brave.kafka.clients.TracingConsumer@1a57f4f9,
kafka_timestampType=[CREATE_TIME], kafka_receivedMessageKey=[null],
kafka_receivedPartitionId=[2], kafka_receivedTopic=[trans-topic],
kafka_receivedTimestamp=[1531382939970],
kafka_batchConvertedHeaders=[{X-B3-SpanId=[B@556a1239,
X-B3-ParentSpanId=[B@11ce7b87, X-B3-Sampled=[B@18d829c3,
X-B3-TraceId=[B@3d0df61d}]}]]
2018-07-12 11:09:00.080 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [hread | mygrp42] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 51 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=78)
2018-07-12 11:09:01.623 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending Heartbeat request to coordinator
localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:01.724 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Received successful Heartbeat response
2018-07-12 11:09:04.709 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending Heartbeat request to coordinator
localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:04.810 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Received successful Heartbeat response
2018-07-12 11:09:07.793 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending Heartbeat request to coordinator
localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:07.894 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Received successful Heartbeat response
2018-07-12 11:09:09.738 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending LeaveGroup request to coordinator
localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:09.740 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Disabling heartbeat thread
2018-07-12 11:09:15.126 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Sending
offsets to transaction: \{trans-topic-2=OffsetAndMetadata{offset=51,
metadata=''}}
2018-07-12 11:09:15.126 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Begin adding offsets
\{trans-topic-2=OffsetAndMetadata{offset=51, metadata=''}} for consumer group
mygrp42 to transaction
2018-07-12 11:09:15.126 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Enqueuing transactional
request (type=AddOffsetsToTxnRequest, transactionalId=transactionId420,
producerId=0, producerEpoch=83, consumerGroupId=mygrp42)
2018-07-12 11:09:15.126 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-1, transactionalId=transactionId420] Sending transactional
request (type=AddOffsetsToTxnRequest, transactionalId=transactionId420,
producerId=0, producerEpoch=83, consumerGroupId=mygrp42) to node localhost:9092
(id: 0 rack: null)
2018-07-12 11:09:15.128 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Successfully added
partition for consumer group mygrp42 to transaction
2018-07-12 11:09:15.128 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-1, transactionalId=transactionId420] Sending transactional
request (type=TxnOffsetCommitRequest, transactionalId=transactionId420,
producerId=0, producerEpoch=83, consumerGroupId=mygrp42,
offsets=\{trans-topic-2=CommittedOffset(offset=51, metadata='')}) to node
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.129 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Successfully added
offsets \{trans-topic-2=CommittedOffset(offset=51, metadata='')} from consumer
group mygrp42 to transaction.
2018-07-12 11:09:15.130 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Initiating transaction
commit
2018-07-12 11:09:15.130 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Transition from state
IN_TRANSACTION to COMMITTING_TRANSACTION
2018-07-12 11:09:15.130 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Enqueuing transactional
request (type=EndTxnRequest, transactionalId=transactionId420, producerId=0,
producerEpoch=83, result=COMMIT)
2018-07-12 11:09:15.130 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-1, transactionalId=transactionId420] Sending transactional
request (type=EndTxnRequest, transactionalId=transactionId420, producerId=0,
producerEpoch=83, result=COMMIT) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.131 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Transition from state
COMMITTING_TRANSACTION to READY
2018-07-12 11:09:15.131 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
2018-07-12 11:09:15.131 INFO [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Revoking previously assigned partitions
[trans-topic-2]
2018-07-12 11:09:15.131 INFO [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions
revoked: [trans-topic-2]
2018-07-12 11:09:15.132 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
2018-07-12 11:09:15.132 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Disabling heartbeat thread
2018-07-12 11:09:15.132 INFO [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] (Re-)joining group
2018-07-12 11:09:15.132 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending JoinGroup ((type:
JoinGroupRequest, groupId=mygrp42, sessionTimeout=15000,
rebalanceTimeout=10000, memberId=, protocolType=consumer,
groupProtocols=org.apache.kafka.common.requests.JoinGroupRequest$ProtocolMetadata@5edc7bc1))
to coordinator localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:15.132 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] LeaveGroup request returned successfully
2018-07-12 11:09:16.580 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Received successful JoinGroup response:
org.apache.kafka.common.requests.JoinGroupResponse@518649f1
2018-07-12 11:09:16.581 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending follower SyncGroup to coordinator
localhost:9092 (id: 2147483647 rack: null): (type=SyncGroupRequest,
groupId=mygrp42, generationId=128,
memberId=consumer-1-73cee281-2953-4657-9f6e-af5d5cb6e247, groupAssignment=)
2018-07-12 11:09:16.582 INFO [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Successfully joined group with generation
128
2018-07-12 11:09:16.583 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Enabling heartbeat thread
2018-07-12 11:09:16.583 INFO [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Setting newly assigned partitions
[trans-topic-2]
2018-07-12 11:09:16.583 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetching committed offsets for
partitions: [trans-topic-2]
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Resetting offset for partition
trans-topic-2 to the committed offset 51
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Committing on
assignment: \{trans-topic-2=OffsetAndMetadata{offset=51, metadata=''}}
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Creating new
transaction with name [null]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Transition from state
READY to IN_TRANSACTION
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Created Kafka
transaction on producer [brave.kafka.clients.TracingProducer@1b458b1b]
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Begin adding offsets
\{trans-topic-2=OffsetAndMetadata{offset=51, metadata=''}} for consumer group
mygrp42 to transaction
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Enqueuing transactional
request (type=AddOffsetsToTxnRequest, transactionalId=transactionId420,
producerId=0, producerEpoch=83, consumerGroupId=mygrp42)
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-1, transactionalId=transactionId420] Sending transactional
request (type=AddOffsetsToTxnRequest, transactionalId=transactionId420,
producerId=0, producerEpoch=83, consumerGroupId=mygrp42) to node localhost:9092
(id: 0 rack: null)
2018-07-12 11:09:16.585 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Successfully added
partition for consumer group mygrp42 to transaction
2018-07-12 11:09:16.586 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-1, transactionalId=transactionId420] Sending transactional
request (type=TxnOffsetCommitRequest, transactionalId=transactionId420,
producerId=0, producerEpoch=83, consumerGroupId=mygrp42,
offsets=\{trans-topic-2=CommittedOffset(offset=51, metadata='')}) to node
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Successfully added
offsets \{trans-topic-2=CommittedOffset(offset=51, metadata='')} from consumer
group mygrp42 to transaction.
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Initiating transaction
commit
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Transition from state
IN_TRANSACTION to COMMITTING_TRANSACTION
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Enqueuing transactional
request (type=EndTxnRequest, transactionalId=transactionId420, producerId=0,
producerEpoch=83, result=COMMIT)
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-1, transactionalId=transactionId420] Sending transactional
request (type=EndTxnRequest, transactionalId=transactionId420, producerId=0,
producerEpoch=83, result=COMMIT) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.588 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-1, transactionalId=transactionId420] Transition from state
COMMITTING_TRANSACTION to READY
2018-07-12 11:09:16.588 INFO [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions
assigned: [trans-topic-2]
2018-07-12 11:09:16.588 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.588 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:17.095 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:17.096 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:17.096 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:17.599 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:17.599 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:17.599 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:18.102 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:18.102 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:18.102 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:18.135 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 0
records
2018-07-12 11:09:18.135 DEBUG [kafka-transaction-microservice-example,,,] 55757
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list:
{}***
*Log for Consumer B*
{code:java}
2018-07-12 11:09:11.009 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 1
records
2018-07-12 11:09:11.010 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Creating new
transaction with name [null]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
2018-07-12 11:09:11.010 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Transition from state
READY to IN_TRANSACTION
2018-07-12 11:09:11.010 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Created Kafka
transaction on producer [brave.kafka.clients.TracingProducer@aca7706]
2018-07-12 11:09:11.013 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] l.a.BatchMessagingMessageListenerAdapter : Processing
[GenericMessage [payload=[data], headers={kafka_offset=[50],
kafka_consumer=brave.kafka.clients.TracingConsumer@300b85c2,
kafka_timestampType=[CREATE_TIME], kafka_receivedMessageKey=[null],
kafka_receivedPartitionId=[2], kafka_receivedTopic=[trans-topic],
kafka_receivedTimestamp=[1531382939970],
kafka_batchConvertedHeaders=[{X-B3-SpanId=[B@44df9896,
X-B3-ParentSpanId=[B@3a54aa3c, X-B3-Sampled=[B@118559f1,
X-B3-TraceId=[B@7dcceb96}]}]]
2018-07-12 11:09:11.016 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Sending
offsets to transaction: {trans-topic-2=OffsetAndMetadata{offset=51,
metadata=''}}
2018-07-12 11:09:11.016 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Begin adding offsets
{trans-topic-2=OffsetAndMetadata{offset=51, metadata=''}} for consumer group
mygrp42 to transaction
2018-07-12 11:09:11.016 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Enqueuing transactional
request (type=AddOffsetsToTxnRequest, transactionalId=transactionId421,
producerId=1, producerEpoch=16, consumerGroupId=mygrp42)
2018-07-12 11:09:11.016 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-2, transactionalId=transactionId421] Sending transactional
request (type=AddOffsetsToTxnRequest, transactionalId=transactionId421,
producerId=1, producerEpoch=16, consumerGroupId=mygrp42) to node localhost:9092
(id: 0 rack: null)
2018-07-12 11:09:11.018 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Successfully added
partition for consumer group mygrp42 to transaction
2018-07-12 11:09:11.018 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-2, transactionalId=transactionId421] Sending transactional
request (type=TxnOffsetCommitRequest, transactionalId=transactionId421,
producerId=1, producerEpoch=16, consumerGroupId=mygrp42,
offsets={trans-topic-2=CommittedOffset(offset=51, metadata='')}) to node
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.019 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Successfully added
offsets {trans-topic-2=CommittedOffset(offset=51, metadata='')} from consumer
group mygrp42 to transaction.
2018-07-12 11:09:11.019 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Initiating transaction
commit
2018-07-12 11:09:11.019 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Transition from state
IN_TRANSACTION to COMMITTING_TRANSACTION
2018-07-12 11:09:11.019 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Enqueuing transactional
request (type=EndTxnRequest, transactionalId=transactionId421, producerId=1,
producerEpoch=16, result=COMMIT)
2018-07-12 11:09:11.019 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-2, transactionalId=transactionId421] Sending transactional
request (type=EndTxnRequest, transactionalId=transactionId421, producerId=1,
producerEpoch=16, result=COMMIT) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.021 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Transition from state
COMMITTING_TRANSACTION to READY
2018-07-12 11:09:11.021 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.023 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:13.023 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:13.023 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:13.023 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.023 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.024 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.024 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.525 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:13.525 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:13.526 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:13.526 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.526 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.526 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.526 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.572 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending Heartbeat request to coordinator
localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:13.574 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Received successful Heartbeat response
2018-07-12 11:09:14.024 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 0
records
2018-07-12 11:09:14.024 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.033 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.545 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.049 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:16.049 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:16.049 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:16.049 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.050 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.050 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.050 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for
partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44,
lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for
partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423,
lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for
partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52,
lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null,
recordsSizeInBytes=0)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for
partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for
partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker
localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.576 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending Heartbeat request to coordinator
localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:16.578 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Attempt to heartbeat failed since group
is rebalancing
2018-07-12 11:09:16.578 INFO [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Revoking previously assigned partitions
[trans-topic-1, trans-topic-0, trans-topic-2]
2018-07-12 11:09:16.578 INFO [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions
revoked: [trans-topic-1, trans-topic-0, trans-topic-2]
2018-07-12 11:09:16.578 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
2018-07-12 11:09:16.578 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Disabling heartbeat thread
2018-07-12 11:09:16.578 INFO [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] (Re-)joining group
2018-07-12 11:09:16.578 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending JoinGroup ((type:
JoinGroupRequest, groupId=mygrp42, sessionTimeout=15000,
rebalanceTimeout=10000,
memberId=consumer-1-041b7478-7f02-4aeb-9fd3-31c0898ecd5c,
protocolType=consumer,
groupProtocols=org.apache.kafka.common.requests.JoinGroupRequest$ProtocolMetadata@5f4ca2f4))
to coordinator localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:16.581 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Received successful JoinGroup response:
org.apache.kafka.common.requests.JoinGroupResponse@4825e9a2
2018-07-12 11:09:16.581 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Performing assignment using strategy
range with subscriptions
{consumer-1-041b7478-7f02-4aeb-9fd3-31c0898ecd5c=Subscription(topics=[trans-topic]),
consumer-1-73cee281-2953-4657-9f6e-af5d5cb6e247=Subscription(topics=[trans-topic])}
2018-07-12 11:09:16.581 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Finished assignment for group:
{consumer-1-041b7478-7f02-4aeb-9fd3-31c0898ecd5c=Assignment(partitions=[trans-topic-0,
trans-topic-1]),
consumer-1-73cee281-2953-4657-9f6e-af5d5cb6e247=Assignment(partitions=[trans-topic-2])}
2018-07-12 11:09:16.581 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Sending leader SyncGroup to coordinator
localhost:9092 (id: 2147483647 rack: null): (type=SyncGroupRequest,
groupId=mygrp42, generationId=128,
memberId=consumer-1-041b7478-7f02-4aeb-9fd3-31c0898ecd5c,
groupAssignment=consumer-1-041b7478-7f02-4aeb-9fd3-31c0898ecd5c,consumer-1-73cee281-2953-4657-9f6e-af5d5cb6e247)
2018-07-12 11:09:16.582 INFO [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Successfully joined group with generation
128
2018-07-12 11:09:16.583 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Enabling heartbeat thread
2018-07-12 11:09:16.583 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] org.apache.kafka.common.metrics.Metrics : Removed sensor
with name trans-topic-2.records-lag
2018-07-12 11:09:16.583 INFO [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Setting newly assigned partitions
[trans-topic-1, trans-topic-0]
2018-07-12 11:09:16.583 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer
clientId=consumer-1, groupId=mygrp42] Fetching committed offsets for
partitions: [trans-topic-1, trans-topic-0]
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Resetting offset for partition
trans-topic-1 to the committed offset 43
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer
clientId=consumer-1, groupId=mygrp42] Resetting offset for partition
trans-topic-0 to the committed offset 422
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Committing on
assignment: {trans-topic-1=OffsetAndMetadata{offset=43, metadata=''},
trans-topic-0=OffsetAndMetadata{offset=422, metadata=''}}
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Creating new
transaction with name [null]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Transition from state
READY to IN_TRANSACTION
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Created Kafka
transaction on producer [brave.kafka.clients.TracingProducer@58834673]
2018-07-12 11:09:16.585 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Begin adding offsets
{trans-topic-1=OffsetAndMetadata{offset=43, metadata=''},
trans-topic-0=OffsetAndMetadata{offset=422, metadata=''}} for consumer group
mygrp42 to transaction
2018-07-12 11:09:16.585 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Enqueuing transactional
request (type=AddOffsetsToTxnRequest, transactionalId=transactionId421,
producerId=1, producerEpoch=16, consumerGroupId=mygrp42)
2018-07-12 11:09:16.585 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-2, transactionalId=transactionId421] Sending transactional
request (type=AddOffsetsToTxnRequest, transactionalId=transactionId421,
producerId=1, producerEpoch=16, consumerGroupId=mygrp42) to node localhost:9092
(id: 0 rack: null)
2018-07-12 11:09:16.586 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Successfully added
partition for consumer group mygrp42 to transaction
2018-07-12 11:09:16.586 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-2, transactionalId=transactionId421] Sending transactional
request (type=TxnOffsetCommitRequest, transactionalId=transactionId421,
producerId=1, producerEpoch=16, consumerGroupId=mygrp42,
offsets={trans-topic-1=CommittedOffset(offset=43, metadata=''),
trans-topic-0=CommittedOffset(offset=422, metadata='')}) to node localhost:9092
(id: 0 rack: null)
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Successfully added
offsets {trans-topic-1=CommittedOffset(offset=43, metadata=''),
trans-topic-0=CommittedOffset(offset=422, metadata='')} from consumer group
mygrp42 to transaction.
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Successfully added
offsets {trans-topic-0=CommittedOffset(offset=422, metadata='')} from consumer
group mygrp42 to transaction.
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Initiating transaction
commit
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Transition from state
IN_TRANSACTION to COMMITTING_TRANSACTION
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Enqueuing transactional
request (type=EndTxnRequest, transactionalId=transactionId421, producerId=1,
producerEpoch=16, result=COMMIT)
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer
clientId=producer-2, transactionalId=transactionId421] Sending transactional
request (type=EndTxnRequest, transactionalId=transactionId421, producerId=1,
producerEpoch=16, result=COMMIT) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.595 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer
clientId=producer-2, transactionalId=transactionId421] Transition from state
COMMITTING_TRANSACTION to READY
2018-07-12 11:09:16.596 INFO [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions
assigned: [trans-topic-1, trans-topic-0]
2018-07-12 11:09:17.024 DEBUG [kafka-transaction-microservice-example,,,] 55753
--- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 0
records
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
