GitHub user skyyyy955 added a comment to the discussion: Paimon's function about compaction and partial-update
The compaction option should be `'write-only' = 'true'`. If these are eight separate jobs writing to the same partition, set this for all writers and use a dedicated compaction job. See the [Paimon 1.2 docs](https://paimon.apache.org/docs/1.2/maintenance/dedicated-compaction/). Your log also shows the same base and current commit user. Were any jobs restored from an old savepoint, or started from the same savepoint? I'd check that before assuming compaction is the only cause. For the column values, plain `partial-update` keeps the latest non-null value. Keeping the first one needs additional configuration; the docs describe [per-column aggregation](https://paimon.apache.org/docs/1.2/primary-key-table/merge-engine/partial-update/#aggregation-for-partial-update). Could you share your Paimon/Flink versions, full table DDL and catalog configuration? Also, does "first" mean the first value received, or the earliest by event time? GitHub link: https://github.com/apache/incubator-xtable/discussions/751#discussioncomment-19313980 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
