NestDream commented on PR #9959:
URL: https://github.com/apache/paimon/pull/9959#issuecomment-5727712070
Repro without any code change (master 8b7fbffcc): stream into a primary-key
table created with
```sql
CREATE TABLE T (id INT, v STRING, PRIMARY KEY (id) NOT ENFORCED) WITH (
'bucket' = '1',
'changelog-producer' = 'full-compaction',
'full-compaction.delta-commits' = '10'
);
```
with a 500 ms checkpoint interval and
`org.apache.paimon.flink.sink.GlobalFullCompactionSinkWrite` at DEBUG. After
the first full compaction the line `Found full compaction snapshot #... with
identifier ...` shows up on every checkpoint (50 times in 60 checkpoints on
master); each one is a walk over the snapshot files down to that COMPACT
snapshot. With this PR it shows up once per full compaction (5 times in the
same run). The snapshot and hint file read counts in the description come from
a `LocalFileIO` subclass that counts the files `prepareCommit` opens, run three
times per variant on the unmodified and the fixed module jar.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
