This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-paimon.git
The following commit(s) were added to refs/heads/master by this push:
new b9262fa55 [doc] Document changelog-producer.row-deduplicate
b9262fa55 is described below
commit b9262fa552e977ba2b7762d2080105d41f3b600a
Author: JingsongLi <[email protected]>
AuthorDate: Tue Jun 27 20:29:25 2023 +0800
[doc] Document changelog-producer.row-deduplicate
---
docs/content/concepts/primary-key-table.md | 6 ++++++
1 file changed, 6 insertions(+)
diff --git a/docs/content/concepts/primary-key-table.md
b/docs/content/concepts/primary-key-table.md
index cfa80dfd0..60d68503f 100644
--- a/docs/content/concepts/primary-key-table.md
+++ b/docs/content/concepts/primary-key-table.md
@@ -248,6 +248,9 @@ Lookup will cache data on the memory and local disk, you
can use the following o
</tbody>
</table>
+Lookup changelog-producer supports `changelog-producer.row-deduplicate` to
avoid generating -U, +U
+changelog for the same record.
+
### Full Compaction
If you think the resource consumption of 'lookup' is too large, you can
consider using 'full-compaction' changelog producer,
@@ -265,6 +268,9 @@ Full compaction changelog producer can produce complete
changelog for any type o
{{< /hint >}}
+Full-compaction changelog-producer supports
`changelog-producer.row-deduplicate` to avoid generating -U, +U
+changelog for the same record.
+
## Sequence Field
By default, the primary key table determines the merge order according to the
input order (the last input record will be the last to merge). However, in
distributed computing,