This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/paimon.git
The following commit(s) were added to refs/heads/master by this push:
new 16fd31fcd [doc] add deletion vectors to append table
16fd31fcd is described below
commit 16fd31fcd779a528532d02fd8cf2ba7682f0d726
Author: Jingsong <[email protected]>
AuthorDate: Fri Jun 21 18:04:54 2024 +0800
[doc] add deletion vectors to append table
---
docs/content/append-table/deletion-vectors.md | 46 +++++++++++++++++++++++++++
1 file changed, 46 insertions(+)
diff --git a/docs/content/append-table/deletion-vectors.md
b/docs/content/append-table/deletion-vectors.md
new file mode 100644
index 000000000..663cdd924
--- /dev/null
+++ b/docs/content/append-table/deletion-vectors.md
@@ -0,0 +1,46 @@
+---
+title: "Deletion Vectors"
+weight: 5
+type: docs
+aliases:
+- /append-table/deletion-vectors.html
+---
+<!--
+Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+-->
+
+# Deletion Vectors
+
+{{< hint info >}}
+Currently only Spark SQL supports `DELETE`, `UPDATE` for append table.
+{{< /hint >}}
+
+Consider SQL:
+```sql
+DELETE FROM my_table WHERE currency = 'UNKNOWN';
+```
+
+By default, it will search for the hit files and then rewrite each file to
remove the
+data that needs to be deleted from the files. This operation is costly.
+
+Deletion vectors mode only marks certain records of the corresponding file for
deletion
+and writes the deletion file, without rewriting the entire file.
+
+## Usage
+
+By specifying `'deletion-vectors.enabled' = 'true'`, the Deletion Vectors mode
can be enabled.
