yihua commented on pull request #4116:
URL: https://github.com/apache/hudi/pull/4116#issuecomment-982139242
When running the Hudi Kafka Connect Sink, although the writes are
successful, the sink keeps throwing the following repetitive errors, which can
be noisy to users. After reverting this PR locally, the errors are gone.
```
14:23:40.363 [task-thread-hudi-sink-0] ERROR
org.apache.hudi.common.util.collection.BitCaskDiskMap - BitCaskDisMap close
error
java.nio.channels.ClosedChannelException: null
at sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:110)
~[?:1.8.0_265]
at sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:379)
~[?:1.8.0_265]
at
org.apache.hudi.common.util.collection.BitCaskDiskMap.close(BitCaskDiskMap.java:270)
[hudi-kafka-connect-bundle-0.10.0-rc2.jar:0.10.0-rc2]
at
org.apache.hudi.common.util.collection.ExternalSpillableMap.close(ExternalSpillableMap.java:261)
[hudi-kafka-connect-bundle-0.10.0-rc2.jar:0.10.0-rc2]
at
org.apache.hudi.connect.writers.BufferedConnectWriter.flushRecords(BufferedConnectWriter.java:121)
[hudi-kafka-connect-bundle-0.10.0-rc2.jar:0.10.0-rc2]
at
org.apache.hudi.connect.writers.AbstractConnectWriter.close(AbstractConnectWriter.java:95)
[hudi-kafka-connect-bundle-0.10.0-rc2.jar:0.10.0-rc2]
at
org.apache.hudi.connect.transaction.ConnectTransactionParticipant.cleanupOngoingTransaction(ConnectTransactionParticipant.java:249)
[hudi-kafka-connect-bundle-0.10.0-rc2.jar:0.10.0-rc2]
at
org.apache.hudi.connect.transaction.ConnectTransactionParticipant.handleAckCommit(ConnectTransactionParticipant.java:209)
[hudi-kafka-connect-bundle-0.10.0-rc2.jar:0.10.0-rc2]
at
org.apache.hudi.connect.transaction.ConnectTransactionParticipant.processRecords(ConnectTransactionParticipant.java:127)
[hudi-kafka-connect-bundle-0.10.0-rc2.jar:0.10.0-rc2]
at org.apache.hudi.connect.HoodieSinkTask.put(HoodieSinkTask.java:114)
[hudi-kafka-connect-bundle-0.10.0-rc2.jar:0.10.0-rc2]
at
org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:581)
[connect-runtime-3.0.0.jar:?]
at
org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:329)
[connect-runtime-3.0.0.jar:?]
at
org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:232)
[connect-runtime-3.0.0.jar:?]
at
org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:201)
[connect-runtime-3.0.0.jar:?]
at
org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:186)
[connect-runtime-3.0.0.jar:?]
at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:241)
[connect-runtime-3.0.0.jar:?]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[?:1.8.0_265]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[?:1.8.0_265]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_265]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_265]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
