liunaijie commented on issue #7393:
URL: https://github.com/apache/seatunnel/issues/7393#issuecomment-2292972420
i checked the log file, find the current system has some bug.
1. in some case get table pimary key not check table exist, and table schema
generate null
```
Create sink 'jdbc' with upstream input catalog-table[database: dhg_copy,
schema: null, table: per_orgs]
```
2. the jdbc split enumerator has some issue, will cancel the job.
```
2024-08-16 11:51:01,688 INFO io.debezium.jdbc.JdbcConnection - Connection
gracefully closed
2024-08-16 11:51:01,697 INFO io.debezium.jdbc.JdbcConnection - Connection
gracefully closed
2024-08-16 11:51:01,698 INFO
org.apache.seatunnel.connectors.cdc.base.source.enumerator.SnapshotSplitAssigner
- SnapshotSplitAssigner created with remaining tables: [test.log]
2024-08-16 11:51:01,698 INFO
org.apache.seatunnel.connectors.cdc.base.source.enumerator.SnapshotSplitAssigner
- SnapshotSplitAssigner created with remaining splits: []
2024-08-16 11:51:01,698 INFO
org.apache.seatunnel.connectors.cdc.base.source.enumerator.SnapshotSplitAssigner
- SnapshotSplitAssigner created with assigned splits: []
2024-08-16 11:51:01,769 INFO
org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase
- Open Source Reader.
2024-08-16 11:51:01,769 INFO
org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received
reader register, readerID:
TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=876674346033086465,
pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}
2024-08-16 11:51:01,784 INFO
org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase
- Open Source Reader.
2024-08-16 11:51:01,784 INFO
org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received
reader register, readerID:
TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=876674346033086465,
pipelineId=1, taskGroupId=30001}, taskID=40001, index=1}
2024-08-16 11:51:01,789 INFO
org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator -
checkpoint is enabled, start schedule trigger pending checkpoint.
2024-08-16 11:51:01,848 INFO
org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received
enough reader, starting enumerator...
2024-08-16 11:51:01,880 INFO
org.apache.seatunnel.connectors.cdc.base.source.enumerator.splitter.AbstractJdbcSourceChunkSplitter
- Start splitting table test.log into chunks...
2024-08-16 11:51:01,931 INFO
org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801
[seatunnel-623149] [5.1] taskDone, taskId = 40000, taskGroup =
TaskGroupLocation{jobId=876674346033086465, pipelineId=1, taskGroupId=30000}
2024-08-16 11:51:01,931 INFO
org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801
[seatunnel-623149] [5.1] task 40000 error with exception:
[java.lang.RuntimeException: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: Generate Splits for table test.log error], cancel
other task in taskGroup TaskGroupLocation{jobId=876674346033086465,
pipelineId=1, taskGroupId=30000}.
2024-08-16 11:51:01,931 INFO
org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase
- Closing Source Reader 0.
```
@chen1274528094 for your case, maybe you can manually add schema config to
source table to avoid this issue, refer this doc
https://seatunnel.apache.org/docs/concept/schema-feature/#how-to-use-schema
@inuex for your case, still need check.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
