This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a commit to branch release-1.12
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/release-1.12 by this push:
new cbb71c5 [FLINK-20315][doc] Optimize the compaction document to warn
users about backpressure
cbb71c5 is described below
commit cbb71c58349abf86d4fb064c19fd50ca0034ce25
Author: Jingsong Lee <[email protected]>
AuthorDate: Wed Dec 2 16:44:56 2020 +0800
[FLINK-20315][doc] Optimize the compaction document to warn users about
backpressure
This closes #14285
---
docs/dev/table/connectors/filesystem.md | 1 +
docs/dev/table/connectors/filesystem.zh.md | 1 +
2 files changed, 2 insertions(+)
diff --git a/docs/dev/table/connectors/filesystem.md
b/docs/dev/table/connectors/filesystem.md
index b808e3c..2b179fc 100644
--- a/docs/dev/table/connectors/filesystem.md
+++ b/docs/dev/table/connectors/filesystem.md
@@ -186,6 +186,7 @@ If enabled, file compaction will merge multiple small files
into larger files ba
When running file compaction in production, please be aware that:
- Only files in a single checkpoint are compacted, that is, at least the same
number of files as the number of checkpoints is generated.
- The file before merging is invisible, so the visibility of the file may be:
checkpoint interval + compaction time.
+- If the compaction takes too long, it will backpressure the job and extend
the time period of checkpoint.
### Partition Commit
diff --git a/docs/dev/table/connectors/filesystem.zh.md
b/docs/dev/table/connectors/filesystem.zh.md
index f170497..4a8f69a 100644
--- a/docs/dev/table/connectors/filesystem.zh.md
+++ b/docs/dev/table/connectors/filesystem.zh.md
@@ -186,6 +186,7 @@ If enabled, file compaction will merge multiple small files
into larger files ba
When running file compaction in production, please be aware that:
- Only files in a single checkpoint are compacted, that is, at least the same
number of files as the number of checkpoints is generated.
- The file before merging is invisible, so the visibility of the file may be:
checkpoint interval + compaction time.
+- If the compaction takes too long, it will backpressure the job and extend
the time period of checkpoint.
### Partition Commit