[
https://issues.apache.org/jira/browse/FLINK-35870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
LEE SOMANG updated FLINK-35870:
-------------------------------
Description:
Currently the `DEFAULT_KAFKA_TRANSACTION_TIMEOUT` value of `KafkaSinkBuilder`
is set to 1 hour.
{code:java}
private static final Duration DEFAULT_KAFKA_TRANSACTION_TIMEOUT =
Duration.ofHours(1); {code}
However, the default value described on the [official Kafka
Website|https://kafka.apache.org/documentation/#brokerconfigs_transaction.max.timeout.ms]
is 15 minutes, so if we leave this set to 1 hour, the following error is
displayed
{code:java}
2024-07-20 16:30:40
org.apache.kafka.common.KafkaException: Unexpected error in
InitProducerIdResponse; The transaction timeout is larger than the maximum
value allowed by the broker (as configured by transaction.max.timeout.ms).
at
org.apache.kafka.clients.producer.internals.TransactionManager$InitProducerIdHandler.handleResponse(TransactionManager.java:1418)
at
org.apache.kafka.clients.producer.internals.TransactionManager$TxnRequestHandler.onComplete(TransactionManager.java:1322)
at org.apache.kafka.clients.ClientResponse.onComplete(ClientResponse.java:109)
at
org.apache.kafka.clients.NetworkClient.completeResponses(NetworkClient.java:583)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:575)
at
org.apache.kafka.clients.producer.internals.Sender.maybeSendAndPollTransactionalRequest(Sender.java:418)
at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:316)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:243)
at java.base/java.lang.Thread.run(Thread.java:829) {code}
So it seems reasonable to change this value from 1 hour to 15 minutes.
was:
Currently the `DEFAULT_KAFKA_TRANSACTION_TIMEOUT` value of `KafkaSinkBuilder`
is set to 1 hour.
{code:java}
private static final Duration DEFAULT_KAFKA_TRANSACTION_TIMEOUT =
Duration.ofHours(1); {code}
However, the default value described on the official Kafka Website is 15
minutes, so if we leave this set to 1 hour, the following error is displayed
{code:java}
2024-07-20 16:30:40
org.apache.kafka.common.KafkaException: Unexpected error in
InitProducerIdResponse; The transaction timeout is larger than the maximum
value allowed by the broker (as configured by transaction.max.timeout.ms).
at
org.apache.kafka.clients.producer.internals.TransactionManager$InitProducerIdHandler.handleResponse(TransactionManager.java:1418)
at
org.apache.kafka.clients.producer.internals.TransactionManager$TxnRequestHandler.onComplete(TransactionManager.java:1322)
at org.apache.kafka.clients.ClientResponse.onComplete(ClientResponse.java:109)
at
org.apache.kafka.clients.NetworkClient.completeResponses(NetworkClient.java:583)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:575)
at
org.apache.kafka.clients.producer.internals.Sender.maybeSendAndPollTransactionalRequest(Sender.java:418)
at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:316)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:243)
at java.base/java.lang.Thread.run(Thread.java:829) {code}
So it seems reasonable to change this value from 1 hour to 15 minutes.
> Change DEFAULT_KAFKA_TRANSACTION_TIMEOUT in KafkaSinkBuilder
> ------------------------------------------------------------
>
> Key: FLINK-35870
> URL: https://issues.apache.org/jira/browse/FLINK-35870
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Kafka
> Reporter: LEE SOMANG
> Priority: Minor
>
> Currently the `DEFAULT_KAFKA_TRANSACTION_TIMEOUT` value of `KafkaSinkBuilder`
> is set to 1 hour.
>
> {code:java}
> private static final Duration DEFAULT_KAFKA_TRANSACTION_TIMEOUT =
> Duration.ofHours(1); {code}
>
>
> However, the default value described on the [official Kafka
> Website|https://kafka.apache.org/documentation/#brokerconfigs_transaction.max.timeout.ms]
> is 15 minutes, so if we leave this set to 1 hour, the following error is
> displayed
>
>
> {code:java}
> 2024-07-20 16:30:40
> org.apache.kafka.common.KafkaException: Unexpected error in
> InitProducerIdResponse; The transaction timeout is larger than the maximum
> value allowed by the broker (as configured by transaction.max.timeout.ms).
> at
> org.apache.kafka.clients.producer.internals.TransactionManager$InitProducerIdHandler.handleResponse(TransactionManager.java:1418)
> at
> org.apache.kafka.clients.producer.internals.TransactionManager$TxnRequestHandler.onComplete(TransactionManager.java:1322)
> at org.apache.kafka.clients.ClientResponse.onComplete(ClientResponse.java:109)
> at
> org.apache.kafka.clients.NetworkClient.completeResponses(NetworkClient.java:583)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:575)
> at
> org.apache.kafka.clients.producer.internals.Sender.maybeSendAndPollTransactionalRequest(Sender.java:418)
> at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:316)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:243)
> at java.base/java.lang.Thread.run(Thread.java:829) {code}
>
>
> So it seems reasonable to change this value from 1 hour to 15 minutes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
