This is an automated email from the ASF dual-hosted git repository.
blue pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/iceberg.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 96481c6 Deployed 349e8e304 with MkDocs version: 1.0.4
96481c6 is described below
commit 96481c6e049a70bb09aecc14aa7231edf6b5929f
Author: Ryan Blue <[email protected]>
AuthorDate: Tue Jul 14 16:14:07 2020 -0800
Deployed 349e8e304 with MkDocs version: 1.0.4
---
index.html | 2 +-
sitemap.xml.gz | Bin 225 -> 225 bytes
spark/index.html | 5 +++++
3 files changed, 6 insertions(+), 1 deletion(-)
diff --git a/index.html b/index.html
index 72574d6..99e34d9 100644
--- a/index.html
+++ b/index.html
@@ -460,5 +460,5 @@
<!--
MkDocs version : 1.0.4
-Build Date UTC : 2020-07-15 00:08:13
+Build Date UTC : 2020-07-15 00:14:07
-->
diff --git a/sitemap.xml.gz b/sitemap.xml.gz
index e3933da..24d7d71 100644
Binary files a/sitemap.xml.gz and b/sitemap.xml.gz differ
diff --git a/spark/index.html b/spark/index.html
index 39ba204..aae18be 100644
--- a/spark/index.html
+++ b/spark/index.html
@@ -726,6 +726,11 @@ spark.sql("""select count(1) from
table""").show()
<h3 id="insert-overwrite"><code>INSERT OVERWRITE</code><a class="headerlink"
href="#insert-overwrite" title="Permanent link">¶</a></h3>
<p>To replace data in the table with the result of a query, use <code>INSERT
OVERWRITE</code>. Overwrites are atomic operations for Iceberg tables.</p>
<p>The partitions that will be replaced by <code>INSERT OVERWRITE</code>
depends on Spark’s partition overwrite mode and the partitioning of a
table.</p>
+<div class="admonition warning">
+<p class="admonition-title">Warning</p>
+<p>Spark 3.0.0 has a correctness bug that affects dynamic <code>INSERT
OVERWRITE</code> with <a href="../partitioning">hidden partitioning</a>, <a
href="https://issues.apache.org/jira/browse/SPARK-32168">SPARK-32168</a>.
+For tables with hidden partitions, wait for Spark 3.0.1.</p>
+</div>
<h4 id="overwrite-behavior">Overwrite behavior<a class="headerlink"
href="#overwrite-behavior" title="Permanent link">¶</a></h4>
<p>Spark’s default overwrite mode is <strong>static</strong>, but
<strong>dynamic overwrite mode is recommended when writing to Iceberg
tables.</strong> Static overwrite mode determines which partitions to overwrite
in a table by converting the <code>PARTITION</code> clause to a filter, but the
<code>PARTITION</code> clause can only reference table columns.</p>
<p>Dynamic overwrite mode is configured by setting
<code>spark.sql.sources.partitionOverwriteMode=dynamic</code>.</p>