201811510411lw commented on issue #11973:
URL: https://github.com/apache/seatunnel/issues/11973#issuecomment-5434896342
Thanks @waterWang and @zhangshenghang for investigating this issue and
providing fixes.
- @waterWang proposed #11977.
- @zhangshenghang proposed #11979.
I verified the core fix from #11979 after cherry-picking it into our
downstream branch based on SeaTunnel 2.3.13.
The test configuration included:
```hocon
table-names-config = [{
table = "<redacted_table>"
primaryKeys = ["ID"]
snapshotSplitColumn = "ID"
}]
startup.mode = "initial"
snapshot.split.size = 4096
```
The configured physical primary key was accepted as the snapshot split
column:
```text
Chosen split column ID for table <redacted_table>
Splitting table <redacted_table> into chunks,
split column: ID,
min: 1,
max: 1280590,
chunk size: 4096
Split table <redacted_table> into 305 chunks.
```
The generated snapshot splits used non-null `ID` boundaries. For example:
```text
SnapshotSplit(
tableId=<redacted_table>,
splitKeyType=ROW<ID BIGINT>,
splitStart=[1223656],
splitEnd=[1227861]
)
```
The previous behavior no longer occurred:
```text
Config snapshotSplitColumn not unique key
```
SeaTunnel did not fall back to another unique-key column.
Therefore, the fix from #11979 resolves the reported issue in our SeaTunnel
2.3.13-based runtime.
Thank you both again for the quick response and contributions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
