fe80 commented on issue #15425:
URL: https://github.com/apache/iceberg/issues/15425#issuecomment-4055878589
@kyrick I'm successful wirte some data inside my s3tables (a table with 14
after 10 retry). But When I add a second table I'm always block with timeout
```
org.apache.kafka.common.errors.TimeoutException: Timeout expired after
60000ms while awaiting EndTxn(false)
2026-03-13 13:55:33 ERROR [task-thread-s3tables-0] WorkerSinkTask:657 -
WorkerSinkTask{id=s3tables-0} Task threw an uncaught and unrecoverable
exception. Task is being killed and will not recover until manually restarted.
Error: Timeout expired after 60000ms while awaiting TxnOffsetCommitHandler
org.apache.kafka.common.errors.TimeoutException: Timeout expired after
60000ms while awaiting TxnOffsetCommitHandler
```
And this is also a little table (8k lines), and I don't have any issue for
writing data with my producer (I'm using kafka 4.1 connector inside eks with
strimzi operator, and Apicurio)
A part of my comnfiguration:
```
iceberg.catalog.client.region: eu-west-3
iceberg.catalog.io-impl: org.apache.iceberg.aws.s3.S3FileIO
iceberg.catalog.rest.auth.type: sigv4
iceberg.catalog.rest.signing-name: s3tables
iceberg.catalog.rest.signing-region: eu-west-3
iceberg.catalog.rest.sigv4-enabled: true
iceberg.catalog.type: rest
iceberg.catalog.uri: https://s3tables.eu-west-3.amazonaws.com/iceberg
iceberg.catalog.warehouse: arn:aws:s3tables:eu-west-3:....
topics.regex: ^my\.regexp\.table
transforms: unwrap,fullTableName,insertTableName
transforms.fullTableName.regex: ^[^.]+\.([^.]+)\.([^.]+)$
transforms.fullTableName.replacement: $1.$2
transforms.fullTableName.type:
org.apache.kafka.connect.transforms.RegexRouter
transforms.insertTableName.topic.field: iceberg_table_name
transforms.insertTableName.type:
org.apache.kafka.connect.transforms.InsertField$Value
transforms.unwrap.drop.tombstones: false
transforms.unwrap.type: io.debezium.transforms.ExtractNewRecordState
transforms.unwrap.delete.handling.mode: rewrite
```
So it's work but I don't know I taking too much time; It's set to 60s for a
transaction It's look like ok for 14 lines... (the consumer and the msk are on
the same region and vpc)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
