[
https://issues.apache.org/jira/browse/FLINK-30419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678429#comment-17678429
]
Alex Sorokoumov commented on FLINK-30419:
-----------------------------------------
> Do you mean we can have a default value for table store catalog for
> `kafka.transaction.timeout.ms`?
Yeah! I think it would be generally useful to be able to override FTS defaults
on the Catalog level. In fact, the FTS Catalog already overrides Table's
{{connector}} and {{path}} fields using its {{type}} and {{warehouse}} fields.
We would extend that to provide arbitrary fields. For example, the table below
gets {{log.system}} and kafka options from the Catalog:
{noformat}
CREATE CATALOG table_store_catalog WITH (
'type'='table-store',
'warehouse'='s3://my-bucket/table-store',
'log.system' = 'kafka',
'kafka.bootstrap.servers' = '<list of kafka brokers>',
'kafka.transaction.timeout.ms' = '900000',
);
USE CATALOG table_store_catalog;
CREATE TABLE word_count (
word STRING PRIMARY KEY NOT ENFORCED,
cnt BIGINT
) WITH (
'kafka.topic' = 'word_count_log'
);{noformat}
WDYT [~lzljs3620320] ?
> Allow tuning of transaction timeout
> -----------------------------------
>
> Key: FLINK-30419
> URL: https://issues.apache.org/jira/browse/FLINK-30419
> Project: Flink
> Issue Type: Improvement
> Components: Table Store
> Reporter: Vicky Papavasileiou
> Priority: Major
>
> FTS sets the producer transaction timeout to 1hr. The maximum allowed by a
> kafka broker is 15 mins. This causes exceptions to be thrown and the job dies
> when kafka log is enabled on a table.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
