This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-paimon.git
The following commit(s) were added to refs/heads/master by this push:
new b8d5689aa [core] add doc for asynchronous expiration. (#2032)
b8d5689aa is described below
commit b8d5689aaabc83225fbcb2d9fb2a0654cfd9dfbb
Author: liming.1018 <[email protected]>
AuthorDate: Sat Sep 16 21:14:31 2023 +0800
[core] add doc for asynchronous expiration. (#2032)
---
docs/content/maintenance/manage-snapshots.md | 19 +++++++++++++++++++
1 file changed, 19 insertions(+)
diff --git a/docs/content/maintenance/manage-snapshots.md
b/docs/content/maintenance/manage-snapshots.md
index 0bcca42a0..d1e8790cf 100644
--- a/docs/content/maintenance/manage-snapshots.md
+++ b/docs/content/maintenance/manage-snapshots.md
@@ -68,6 +68,20 @@ Snapshot expiration is controlled by the following table
properties.
<td>Integer</td>
<td>The maximum number of completed snapshots to retain. Should be
greater than or equal to the minimum number.</td>
</tr>
+ <tr>
+ <td><h5>snapshot.expire.execution-mode</h5></td>
+ <td>No</td>
+ <td style="word-wrap: break-word;">sync</td>
+ <td>Enum</td>
+ <td>Specifies the execution mode of expire.</td>
+ </tr>
+ <tr>
+ <td><h5>snapshot.expire.limit</h5></td>
+ <td>No</td>
+ <td style="word-wrap: break-word;">10</td>
+ <td>Integer</td>
+ <td>The maximum number of snapshots allowed to expire at a time.</td>
+ </tr>
</tbody>
</table>
@@ -207,6 +221,11 @@ Please note that too short retain time or too small retain
number may result in:
[Consumer Id]({{< ref "how-to/querying-tables#consumer-id" >}}) to protect
streaming reading
in a small retain time of snapshot expiration).
+By default, paimon will delete expired snapshots synchronously. When there are
too
+many files that need to be deleted, they may not be deleted quickly and
back-pressured
+to the upstream operator. To avoid this situation, users can use asynchronous
expiration
+mode by setting `snapshot.expire.execution-mode` to `async`.
+
## Rollback to Snapshot
Rollback a table to a specific snapshot ID.
