[ https://issues.apache.org/jira/browse/KAFKA-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
wenxuanguan updated KAFKA-8451: ------------------------------- Description: It's common in distributed system that multiple producer instances send message in one transaction concurrently, and the transaction is committed when all the producer send message successfully. Otherwise, if one producer failed, the transaction is aborted and no message will be consumed. However, when multiple producer share the same txn id, throw the following exception: org.apache.kafka.common.KafkaException: Cannot execute transactional method because we are in an error state at org.apache.kafka.clients.producer.internals.TransactionManager.maybeFailWithError(TransactionManager.java:784) at org.apache.kafka.clients.producer.internals.TransactionManager.beginTransaction(TransactionManager.java:215) at org.apache.kafka.clients.producer.KafkaProducer.beginTransaction(KafkaProducer.java:606) at com.matt.test.kafka.producer.ProducerTransactionExample.main(ProducerTransactionExample.java:68) Caused by: org.apache.kafka.common.errors.ProducerFencedException: Producer attempted an operation with an old epoch. Either there is a newer producer with the same transactionalId, or the producer's transaction has been expired by the broker. was: It's common in distributed system that multiple producer instances send message in one transaction concurrently, and if one producer failed, the other producer abort transaction. However, when multiple producer share the same txn id, throw the following exception: org.apache.kafka.common.KafkaException: Cannot execute transactional method because we are in an error state at org.apache.kafka.clients.producer.internals.TransactionManager.maybeFailWithError(TransactionManager.java:784) at org.apache.kafka.clients.producer.internals.TransactionManager.beginTransaction(TransactionManager.java:215) at org.apache.kafka.clients.producer.KafkaProducer.beginTransaction(KafkaProducer.java:606) at com.matt.test.kafka.producer.ProducerTransactionExample.main(ProducerTransactionExample.java:68) Caused by: org.apache.kafka.common.errors.ProducerFencedException: Producer attempted an operation with an old epoch. Either there is a newer producer with the same transactionalId, or the producer's transaction has been expired by the broker. > transaction support multiple producer instance > ---------------------------------------------- > > Key: KAFKA-8451 > URL: https://issues.apache.org/jira/browse/KAFKA-8451 > Project: Kafka > Issue Type: Bug > Reporter: wenxuanguan > Priority: Major > > It's common in distributed system that multiple producer instances send > message in one transaction concurrently, and the transaction is committed > when all the producer send message successfully. Otherwise, if one producer > failed, the transaction is aborted and no message will be consumed. > However, when multiple producer share the same txn id, throw the following > exception: > org.apache.kafka.common.KafkaException: Cannot execute transactional method > because we are in an error state > at > org.apache.kafka.clients.producer.internals.TransactionManager.maybeFailWithError(TransactionManager.java:784) > at > org.apache.kafka.clients.producer.internals.TransactionManager.beginTransaction(TransactionManager.java:215) > at > org.apache.kafka.clients.producer.KafkaProducer.beginTransaction(KafkaProducer.java:606) > at > com.matt.test.kafka.producer.ProducerTransactionExample.main(ProducerTransactionExample.java:68) > Caused by: org.apache.kafka.common.errors.ProducerFencedException: Producer > attempted an operation with an old epoch. Either there is a newer producer > with the same transactionalId, or the producer's transaction has been expired > by the broker. -- This message was sent by Atlassian JIRA (v7.6.3#76005)